00000001:02000400:2.0F:1788573954.136800:0:2963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788573973.788880:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788573975.793858:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 521 MB/s 00000001:01000000:2.0:1788573976.044321:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 807 MB/s 00000001:01000000:1.0F:1788573976.293414:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4647 MB/s 00000020:02000000:2.0:1788573977.141680:0:3281:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g4a08d7b 00000400:02000000:1.0:1788573978.127688:0:3296:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.157@tcp [8/256/0/180] 00008000:02000000:3.0:1788573982.351638:0:3445:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788574032.679865:0:5253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788574043.297332:0:5838:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788574043.297340:0:5838:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788574043.297492:0:5838:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000074929c59 00000080:02000400:1.0:1788574043.297504:0:5838:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788574043.304069:0:5838:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788574043.304082:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788574043.316174:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003a37cf7b) 00000020:00000080:2.0:1788574043.316205:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0F:1788574043.360307:0:5838:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788574043.365073:0:5838:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788574043.404691:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788574043.404732:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788574043.404754:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788574043.404805:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788574043.404832:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788574043.406536:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788574043.406547:0:5838:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788574043.406559:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b5355b4 00000020:01000004:2.0:1788574043.406567:0:5838:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788574043.406572:0:5838:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788574043.406577:0:5838:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000074929c59 from MGS 00000020:01000004:2.0:1788574043.406581:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788574043.406592:0:5838:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008b81e69c) 00000020:00000080:2.0:1788574043.406602:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788574043.406670:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074929c59 from MGS, refs=2 00080000:01000000:2.0:1788574043.406676:0:5838:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574043.406681:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b5355c2 00000100:00100000:2.0:1788574043.406780:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788574043.406912:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788574043.406918:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788574043.409253:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788574043.409265:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788574043.411191:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574043.411645:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788574043.411653:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788574043.422161:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788574043.422192:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788574043.424980:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788574043.425003:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788574043.425902:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574043.425906:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574043.425908:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574043.426157:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574043.426159:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574043.426161:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574043.426823:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788574043.434074:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788574043.675606:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3143 MB/s 00000001:01000000:2.0:1788574043.925564:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2991 MB/s 00000001:01000000:1.0:1788574044.176838:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 868 MB/s 00000001:01000000:2.0:1788574044.427400:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 655 MB/s 00080000:10000000:2.0:1788574044.434282:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788574044.467577:0:5838:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788574044.467606:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788574044.467609:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788574044.468709:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788574044.468783:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788574044.468831:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788574044.469093:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788574044.469123:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788574044.469623:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574044.469791:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788574044.469797:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:2.0:1788574044.482531:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574044.482855:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788574044.482867:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788574044.483398:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788574044.483407:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788574044.484778:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788574044.484802:0:5838:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.157@tcp' 00000020:01000004:0.0:1788574044.484804:0:5838:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788574044.484858:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.157@tcp (typ=mgc) 00000020:00000080:0.0:1788574044.484879:0:5838:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.157@tcp (00000000fefe6ba1) 00000020:00000080:0.0:1788574044.484897:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1788574044.485115:0:5853:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1788574044.486408:0:5838:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b804e055@MGC192.168.201.157@tcp: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788574044.486624:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.157@tcp-0 is initialized 00000040:01000000:0.0:1788574044.486632:0:5838:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788574044.486881:0:5854:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788574044.486915:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.157@tcp (uuid 2a547233-5b7a-4801-b1c0-26875afe1265) 00000020:00000080:0.0:1788574044.486933:0:5838:0:(genops.c:1385:class_connect()) connect: client 2a547233-5b7a-4801-b1c0-26875afe1265, cookie 0x10531a153b5355d0 00000100:00080000:0.0:1788574044.486946:0:5838:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574044.486951:0:5838:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import 00000000b804e055 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574044.487008:0:5838:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eeff530b x1875455747555456/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574044.487077:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a547233-5b7a-4801-b1c0-26875afe1265:3311:1875455747555456:0@lo:250: 00000100:00100000:0.0:1788574044.487170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574044.494814:0:5838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2a547233-5b7a-4801-b1c0-26875afe1265->MGS 00000020:01000004:1.0:1788574044.494848:0:5838:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788574044.494876:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788574044.494903:0:5838:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000b34d713) 00000020:00000080:1.0:1788574044.494925:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788574044.502205:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747555456 00000100:00100000:0.0:1788574044.502221:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747555456 00000100:00100000:0.0:1788574044.503575:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574044.503586:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ebfb0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875455747555456:12345-0@lo:250: 00010000:00080000:0.0:1788574044.503618:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2a547233-5b7a-4801-b1c0-26875afe1265@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1788574044.503647:0:5849:0:(genops.c:1385:class_connect()) connect: client 2a547233-5b7a-4801-b1c0-26875afe1265, cookie 0x10531a153b5355de 00000100:00080000:0.0:1788574044.503786:0:5849:0:(import.c:65:import_set_state_nolock()) 000000007830f5fe : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574044.503865:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ebfb0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+5:3311:x1875455747555456:12345-0@lo:250: Request processed in 279us (16695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574044.503872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574044.503913:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788574044.503921:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.157@tcp: connect to target with instance 0 00000100:00080000:0.0:1788574044.503927:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788574044.503932:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788574044.503935:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000b804e055 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788574044.503937:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788574044.503940:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788574044.503944:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a547233-5b7a-4801-b1c0-26875afe1265:3311:1875455747555456:0@lo:250: 00000100:00100000:1.0:1788574044.515746:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574044.515940:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788574044.515947:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788574044.523113:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574044.524225:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788574044.531047:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574044.531063:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788574044.531788:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574044.531977:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788574044.531983:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788574044.539766:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788574044.539783:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788574044.569720:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574044.569941:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788574044.569947:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788574044.571114:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788574044.571126:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788574044.571846:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574044.572102:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788574044.572109:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788574044.572727:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788574044.572742:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788574044.573324:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574044.573629:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788574044.573635:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788574044.574210:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788574044.574216:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788574044.574771:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574044.574906:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788574044.574912:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788574044.575571:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788574044.575578:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788574044.608676:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574044.608953:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574044.608961:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788574044.610747:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574044.610764:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788574044.613643:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574044.613664:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788574044.616861:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788574044.616891:0:5838:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788574044.616897:0:5838:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788574044.617200:0:5838:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788574044.617236:0:5838:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788574044.617240:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788574044.617241:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574044.617243:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574044.617244:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574044.617245:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574044.617246:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574044.617248:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574044.617249:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574044.617250:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574044.617254:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574044.617255:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574044.617257:0:5838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574044.617259:0:5838:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788574044.617261:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574044.617262:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574044.617262:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574044.617263:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574044.617264:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574044.617265:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574044.617266:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574044.617267:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574044.617268:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574044.617269:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574044.617270:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574044.617270:0:5838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574044.621910:0:5838:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788574044.622246:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d26de724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555584:0@lo:253: 00000100:00100000:3.0:1788574044.622500:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574044.622645:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d0570fb going to sleep for 11 seconds 00000100:00100000:0.0:1788574044.622736:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747555584 00000100:00100000:0.0:1788574044.622744:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747555584 00000100:00100000:0.0:1788574044.622797:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574044.622804:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a16f875c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+5:5838:x1875455747555584:12345-0@lo:253: 20000000:01000000:0.0:1788574044.622850:0:5852:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788574044.622854:0:5852:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788574044.623586:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788574044.623646:0:5852:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788574044.624093:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574044.625258:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788574044.625631:0:5852:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788574044.625638:0:5852:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788574044.625644:0:5852:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788574044.625648:0:5852:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788574044.625663:0:5852:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788574044.625875:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574044.626742:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788574044.626763:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788574044.626818:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788574044.626866:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788574044.626905:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788574044.627265:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788574044.627275:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788574044.627482:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788574044.627491:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788574044.627522:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788574044.627529:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788574044.627556:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788574044.627604:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788574044.627641:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788574044.627647:0:5852:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788574044.627658:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574044.627856:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788574044.627867:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788574044.627901:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788574044.628100:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788574044.628164:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788574044.628176:0:5852:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788574044.628253:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788574044.628262:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788574044.628552:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788574044.628596:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788574044.628633:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788574044.628645:0:5852:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788574044.628734:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788574044.628744:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788574044.628777:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788574044.628812:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788574044.630205:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788574044.630281:0:5852:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788574044.630355:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788574044.631605:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788574044.633940:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788574044.634227:0:5852:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.157@tcp for mdt 20000000:01000000:1.0:1788574044.634230:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:1.0:1788574044.634275:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788574044.634284:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788574044.634311:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788574044.634318:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:1.0:1788574044.634363:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788574044.634395:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788574044.634428:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788574044.634480:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788574044.634565:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788574044.634567:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788574044.634580:0:5852:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788574044.634586:0:5852:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788574044.635119:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788574044.635326:0:5852:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788574044.643585:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788574044.643655:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788574044.643737:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788574044.643760:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788574044.643764:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788574044.643768:0:5852:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788574044.643783:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788574044.643785:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788574044.643822:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788574044.643824:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788574044.644867:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788574044.645144:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788574044.645183:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788574044.645240:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788574044.645253:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788574044.645267:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788574044.645976:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788574044.646244:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788574044.646315:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788574044.646352:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788574044.646570:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574044.646573:0:5852:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788574044.646581:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788574044.646601:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646619:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646630:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646636:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646642:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646649:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646655:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d843c649 already unused, calling callback (00000000317dfd86) 00010000:00010000:3.0:1788574044.646658:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646666:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646677:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646697:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.646703:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d843c649/0x10531a153b5355e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788574044.646720:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788574044.945197:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a16f875c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+5:5838:x1875455747555584:12345-0@lo:253: Request processed in 322381us (322685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574044.945216:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d26de724 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555584:0@lo:253: 00000100:00100000:3.0:1788574044.945222:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:0.0:1788574044.945237:0:5838:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788574044.945241:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574044.945243:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574044.945245:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574044.945245:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788574044.945247:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574044.945248:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574044.945250:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574044.945251:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574044.945252:0:5838:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788574044.945254:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574044.945255:0:5838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574044.945276:0:5838:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000074929c59 from lustre-MDT0000 10000000:01000000:0.0:1788574044.945529:0:5838:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788574044.945534:0:5838:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788574044.945539:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a792418000 10000000:01000000:0.0:1788574044.945545:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574044.945573:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a792418000 from 1 10000000:01000000:0.0:1788574044.945576:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788574044.945624:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.945636:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.945646:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574044.945665:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555712:0@lo:101: 00000100:00100000:0.0:1788574044.945704:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574044.945789:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747555712 00000100:00100000:3.0:1788574044.945797:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747555712 00000100:00100000:0.0:1788574044.945810:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd07d745 going to sleep for 11 seconds 00000100:00100000:3.0:1788574044.945854:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574044.945863:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5089f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+5:5838:x1875455747555712:12345-0@lo:101: 00010000:00010000:3.0:1788574044.945877:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574044.945891:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d843c649/0x10531a153b5355f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5355ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.945917:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d843c649/0x10531a153b5355f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5355ec expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.945927:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d843c649/0x10531a153b5355f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5355ec expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.945937:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d843c649, rc 0) 00000100:00100000:3.0:1788574044.945983:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5089f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+6:5838:x1875455747555712:12345-0@lo:101: Request processed in 122us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574044.945990:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574044.946003:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555712:0@lo:101: 00010000:00010000:0.0:1788574044.946018:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946027:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574044.946073:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555840:0@lo:501: 00000100:00100000:0.0:1788574044.946098:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574044.946120:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd07d745 going to sleep for 11 seconds 00000100:00100000:3.0:1788574044.946144:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747555840 00000100:00100000:3.0:1788574044.946149:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747555840 00000100:00100000:3.0:1788574044.946178:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574044.946186:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5a955ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+6:5838:x1875455747555840:12345-0@lo:501: 00000100:00100000:3.0:1788574044.946438:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5a955ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+6:5838:x1875455747555840:12345-0@lo:501: Request processed in 244us (330us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574044.946446:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574044.946469:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555840:0@lo:501: 10000000:01000000:0.0:1788574044.946496:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788574044.946555:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946573:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 000000002444dcda/0x10531a153b5355ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574044.946580:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a790a3d000 10000000:01000000:0.0:1788574044.946584:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788574044.946588:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a790a3d000 10000000:01000000:0.0:1788574044.946590:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788574044.946592:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a790a3d000 from 1 10000000:01000000:0.0:1788574044.946594:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788574044.946611:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946617:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946623:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574044.946634:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555968:0@lo:101: 00000100:00100000:0.0:1788574044.946658:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574044.946682:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd07d745 going to sleep for 11 seconds 00000100:00100000:3.0:1788574044.946740:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747555968 00000100:00100000:3.0:1788574044.946745:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747555968 00000100:00100000:3.0:1788574044.946769:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574044.946774:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff522d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+6:5838:x1875455747555968:12345-0@lo:101: 00010000:00010000:3.0:1788574044.946781:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574044.946791:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005df08c09/0x10531a153b535601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5355fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.946803:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005df08c09/0x10531a153b535601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5355fa expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.946811:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005df08c09/0x10531a153b535601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5355fa expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.946817:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005df08c09, rc 0) 00000100:00100000:3.0:1788574044.946847:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff522d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+7:5838:x1875455747555968:12345-0@lo:101: Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574044.946853:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574044.946880:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747555968:0@lo:101: 00010000:00010000:0.0:1788574044.946892:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946899:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574044.946921:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788574044.946935:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946941:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 000000000a512e90/0x10531a153b5355fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574044.946947:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788574044.946950:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574044.946955:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a790a3d000 10000000:01000000:0.0:1788574044.946957:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788574044.946960:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788574044.946961:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574044.946975:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946981:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.946987:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574044.946997:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556096:0@lo:101: 00000100:00100000:0.0:1788574044.947023:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574044.947043:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd07d745 going to sleep for 11 seconds 00000100:00100000:3.0:1788574044.947066:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556096 00000100:00100000:3.0:1788574044.947071:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556096 00000100:00100000:3.0:1788574044.947099:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574044.947106:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f45ef557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+7:5838:x1875455747556096:12345-0@lo:101: 00010000:00010000:3.0:1788574044.947118:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574044.947124:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7b620a1/0x10531a153b53560f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535608 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.947136:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7b620a1/0x10531a153b53560f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535608 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.947144:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7b620a1/0x10531a153b53560f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535608 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574044.947150:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7b620a1, rc 0) 00000100:00100000:3.0:1788574044.947178:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f45ef557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+8:5838:x1875455747556096:12345-0@lo:101: Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574044.947185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574044.947200:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556096:0@lo:101: 00010000:00010000:0.0:1788574044.947211:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574044.947229:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574044.947263:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556224:0@lo:501: 00000100:00100000:0.0:1788574044.947300:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574044.947317:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd07d745 going to sleep for 11 seconds 00000100:00100000:3.0:1788574044.947393:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556224 00000100:00100000:3.0:1788574044.947397:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556224 00000100:00100000:3.0:1788574044.947424:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574044.947438:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7579f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+8:5838:x1875455747556224:12345-0@lo:501: 00000100:00100000:3.0:1788574044.947630:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7579f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+9:5838:x1875455747556224:12345-0@lo:501: Request processed in 201us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574044.947637:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574044.947665:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556224:0@lo:501: 00000100:00100000:0.0:1788574044.947692:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556352:0@lo:503: 00000100:00100000:0.0:1788574044.947730:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574044.947759:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd07d745 going to sleep for 11 seconds 00000100:00100000:3.0:1788574044.947812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556352 00000100:00100000:3.0:1788574044.947817:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556352 00000100:00100000:3.0:1788574044.947839:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574044.947846:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb583dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+9:5838:x1875455747556352:12345-0@lo:503: 00000100:00100000:3.0:1788574044.948002:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb583dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+9:5838:x1875455747556352:12345-0@lo:503: Request processed in 157us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574044.948009:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574044.948024:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556352:0@lo:503: 00000100:00100000:3.0:1788574044.948405:0:5880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000164cb6bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5880:1875455747556480:0@lo:502: 00000100:00100000:3.0:1788574044.948452:0:5880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574044.948487:0:5880:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce3f7d99 going to sleep for 11 seconds 00000100:00100000:0.0:1788574044.948499:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556480 00000100:00100000:0.0:1788574044.948505:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556480 00000100:00100000:0.0:1788574044.948538:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574044.948544:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bf3d68d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+9:5880:x1875455747556480:12345-0@lo:502: 00000100:00100000:0.0:1788574044.948708:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bf3d68d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+9:5880:x1875455747556480:12345-0@lo:502: Request processed in 164us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574044.948715:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574044.949067:0:5880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000164cb6bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5880:1875455747556480:0@lo:502: 00000020:01000000:3.0:1788574044.949091:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574044.949101:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574044.949104:0:5880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788574044.949108:0:5880:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788574044.949111:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574044.949133:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000acfddc70) 00000020:00000080:3.0:1788574044.949150:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788574044.949154:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788574044.949244:0:5880:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788574044.949250:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b53561d 00000020:00000080:3.0:1788574044.949501:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788574044.949506:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574044.949510:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574044.949511:0:5880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788574044.949514:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574044.949517:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574044.949518:0:5880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788574044.949521:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574044.949527:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000130d80ff) 00000020:00000080:3.0:1788574044.949535:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788574044.949538:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788574044.949540:0:5880:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788574044.949542:0:5880:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788574044.949548:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574044.949588:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074929c59 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788574044.949597:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001872948c) 00000020:00000080:3.0:1788574044.949604:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788574044.949659:0:5880:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788574044.949665:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b535632 00000020:00000080:3.0:1788574044.949747:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788574044.949752:0:5880:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788574044.949756:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x10531a153b535639 00080000:01000000:3.0:1788574044.949760:0:5880:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788574044.949763:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b535640 00080000:10000000:3.0:1788574044.951326:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788574044.951628:0:5880:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788574044.961409:0:5880:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788574045.036591:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788574045.036948:0:5880:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788574045.039670:0:5880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788574045.040043:0:5880:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788574045.093694:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000039aea087) 00000020:00000080:3.0:1788574045.093718:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788574045.093792:0:5880:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788574045.093808:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b53564e 00000020:00000080:2.0:1788574045.102829:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788574045.105586:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788574045.159091:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.192829:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.224708:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574045.291758:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574045.337707:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788574045.374441:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x10531a153b535655 00000020:00000080:1.0:1788574045.374714:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788574045.374725:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574045.374730:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574045.374733:0:5880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788574045.374736:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574045.374742:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574045.374743:0:5880:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788574045.374747:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788574045.374785:0:5880:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788574045.374800:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574045.374802:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574045.374804:0:5880:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788574045.374812:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574045.374815:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574045.374816:0:5880:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574045.374819:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574045.374820:0:5880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788574045.374886:0:5880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083545f73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5880:1875455747556608:0@lo:502: 00000100:00100000:1.0:1788574045.374978:0:5880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574045.375106:0:5880:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e19ce8 going to sleep for 11 seconds 00000100:00100000:1.0:1788574045.375139:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556608 00000100:00100000:1.0:1788574045.375145:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556608 00000100:00100000:1.0:1788574045.375183:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574045.375190:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2d48ce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+9:5880:x1875455747556608:12345-0@lo:502: 00000100:00100000:1.0:1788574045.375597:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2d48ce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+9:5880:x1875455747556608:12345-0@lo:502: Request processed in 406us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574045.375605:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574045.375656:0:5880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083545f73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5880:1875455747556608:0@lo:502: 00000020:01000000:1.0:1788574045.375682:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574045.375685:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574045.375687:0:5880:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788574045.375690:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788574045.376234:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788574045.376257:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788574045.376315:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.376339:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 0000000001856f10/0x10531a153b535608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574045.376348:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a790a3d000 from 1 10000000:01000000:0.0:1788574045.376350:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574045.376402:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.376410:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.376419:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574045.376446:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556736:0@lo:101: 00000100:00100000:0.0:1788574045.376484:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.376520:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d84bdc29 going to sleep for 11 seconds 00000100:00100000:3.0:1788574045.376589:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556736 00000100:00100000:3.0:1788574045.376597:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556736 00000100:00100000:3.0:1788574045.376628:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574045.376635:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0f011ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+9:5838:x1875455747556736:12345-0@lo:101: 00010000:00010000:3.0:1788574045.376645:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574045.376657:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53565c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.376676:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53565c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.376686:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53565c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.376693:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094e4a4df, rc 0) 00000100:00100000:3.0:1788574045.376739:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0f011ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+10:5838:x1875455747556736:12345-0@lo:101: Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.376745:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574045.376825:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556736:0@lo:101: 00010000:00010000:0.0:1788574045.376838:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.376846:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574045.377437:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556864:0@lo:256: 00000100:00100000:0.0:1788574045.377474:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.377497:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d84bdc29 going to sleep for 11 seconds 00000100:00100000:3.0:1788574045.377624:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556864 00000100:00100000:3.0:1788574045.377631:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556864 00000100:00100000:3.0:1788574045.377661:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574045.377667:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000472fd12c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+10:5838:x1875455747556864:12345-0@lo:256: 20000000:01000000:3.0:1788574045.377680:0:5851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788574045.377686:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788574045.377742:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000472fd12c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+10:5838:x1875455747556864:12345-0@lo:256: Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.377748:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574045.377825:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556864:0@lo:256: 10000000:01000000:0.0:1788574045.378742:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574045.379188:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379200:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574045.379206:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a790a3d000 from 1 10000000:01000000:0.0:1788574045.379209:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574045.379242:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379249:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379258:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574045.379276:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556992:0@lo:101: 00000100:00100000:0.0:1788574045.379325:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.379360:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d84bdc29 going to sleep for 11 seconds 00000100:00100000:0.0:1788574045.379400:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747556992 00000100:00100000:0.0:1788574045.379406:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747556992 00000100:00100000:0.0:1788574045.379448:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574045.379455:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053e6211b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+10:5838:x1875455747556992:12345-0@lo:101: 00010000:00010000:0.0:1788574045.379466:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574045.379479:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53566a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379512:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53566a expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379521:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53566a expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379529:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df420bb2, rc 0) 00000100:00100000:0.0:1788574045.379562:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053e6211b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747556992:12345-0@lo:101: Request processed in 108us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574045.379568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574045.379604:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747556992:0@lo:101: 00010000:00010000:0.0:1788574045.379616:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.379623:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574045.379668:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557120:0@lo:501: 00000100:00100000:0.0:1788574045.379691:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.379702:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d84bdc29 going to sleep for 11 seconds 00000100:00100000:0.0:1788574045.379712:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557120 00000100:00100000:0.0:1788574045.379716:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557120 00000100:00100000:0.0:1788574045.379729:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574045.379733:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b21b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747557120:12345-0@lo:501: 00000100:00100000:0.0:1788574045.380545:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b21b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747557120:12345-0@lo:501: Request processed in 809us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574045.380555:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574045.380722:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeff530b pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557120:0@lo:501: 00000100:00100000:3.0:1788574045.380757:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000164cb6bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557248:0@lo:503: 00000100:00100000:3.0:1788574045.380796:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.380831:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000788f705b going to sleep for 11 seconds 00000100:00100000:1.0:1788574045.380885:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557248 00000100:00100000:1.0:1788574045.380890:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557248 00000100:00100000:1.0:1788574045.380925:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574045.380932:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fd9edda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747557248:12345-0@lo:503: 00000040:00080000:1.0:1788574045.380978:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574045.381139:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fd9edda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747557248:12345-0@lo:503: Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574045.381146:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574045.381220:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000164cb6bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557248:0@lo:503: 00000040:00080000:3.0:1788574045.382167:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788574045.382399:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788574045.382437:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574045.382698:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574045.382710:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574045.382754:0:5838:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788574045.382757:0:5838:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a790a3d000 10000000:01000000:1.0:1788574045.382760:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a790a3d000 10000000:01000000:1.0:1788574045.382763:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574045.382768:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a790a3d000 from 1 10000000:01000000:1.0:1788574045.382771:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574045.382804:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574045.382811:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574045.382820:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574045.382840:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083545f73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557376:0@lo:101: 00000100:00100000:1.0:1788574045.382892:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574045.382968:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bee8d9e5 going to sleep for 11 seconds 00000100:00100000:3.0:1788574045.383140:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557376 00000100:00100000:3.0:1788574045.383147:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557376 00000100:00100000:3.0:1788574045.383215:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574045.383223:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb414079 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747557376:12345-0@lo:101: 00010000:00010000:3.0:1788574045.383235:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574045.383247:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e36426c/0x10531a153b53567f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535678 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.383270:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e36426c/0x10531a153b53567f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535678 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.383288:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e36426c/0x10531a153b53567f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535678 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.383297:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e36426c, rc 0) 00000100:00100000:3.0:1788574045.383345:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb414079 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:5838:x1875455747557376:12345-0@lo:101: Request processed in 123us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.383351:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574045.383461:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083545f73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557376:0@lo:101: 00010000:00010000:2.0:1788574045.383476:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574045.383484:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574045.383533:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e9037e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557504:0@lo:501: 00000100:00100000:2.0:1788574045.383589:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574045.383782:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000002897654c going to sleep for 11 seconds 00000100:00100000:1.0:1788574045.383833:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557504 00000100:00100000:1.0:1788574045.383838:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557504 00000100:00100000:1.0:1788574045.383857:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574045.383861:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000046c3ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5838:x1875455747557504:12345-0@lo:501: 00000100:00100000:1.0:1788574045.384181:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000046c3ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5838:x1875455747557504:12345-0@lo:501: Request processed in 319us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574045.384193:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574045.384227:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e9037e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557504:0@lo:501: 00000100:00100000:1.0:1788574045.384251:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557632:0@lo:503: 00000100:00100000:1.0:1788574045.384285:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574045.384298:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056115d09 going to sleep for 11 seconds 00000100:00100000:1.0:1788574045.384310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557632 00000100:00100000:1.0:1788574045.384314:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557632 00000100:00100000:1.0:1788574045.384329:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574045.384333:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0dc30d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5838:x1875455747557632:12345-0@lo:503: 00000100:00100000:1.0:1788574045.384782:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0dc30d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5838:x1875455747557632:12345-0@lo:503: Request processed in 448us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574045.384789:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574045.384827:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747557632:0@lo:503: 00000100:00100000:2.0:1788574045.385551:0:5885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046fde568 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5885:1875455747557760:0@lo:502: 00000100:00100000:2.0:1788574045.385594:0:5885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574045.385625:0:5885:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032db08b7 going to sleep for 11 seconds 00000100:00100000:1.0:1788574045.385676:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557760 00000100:00100000:1.0:1788574045.385682:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557760 00000100:00100000:1.0:1788574045.385717:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574045.385723:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f54ab464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5885:x1875455747557760:12345-0@lo:502: 00000100:00100000:1.0:1788574045.386129:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f54ab464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5885:x1875455747557760:12345-0@lo:502: Request processed in 405us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574045.386137:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574045.386288:0:5885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046fde568 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5885:1875455747557760:0@lo:502: 00000020:01000004:2.0:1788574045.386343:0:5885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788574045.386357:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006b59f05c) 00000020:00000080:2.0:1788574045.386480:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788574045.386551:0:5885:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074929c59 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788574045.386555:0:5885:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000074929c59 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788574045.386557:0:5885:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000074929c59 4 00010000:00080000:2.0:1788574045.386583:0:5885:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d6e9621e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788574045.388619:0:5885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788574045.388864:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788574045.388895:0:5885:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788574045.388909:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x10531a153b53568d 00000100:00080000:2.0:1788574045.388919:0:5885:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574045.388924:0:5885:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d6e9621e using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574045.388970:0:5885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000046fde568 x1875455747557888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574045.388994:0:5885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788574045.389180:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046fde568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747557888:0@lo:38: 00000100:00100000:0.0:1788574045.389250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.389717:0:5885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000551a9dca pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5885:1875455747558016:0@lo:502: 00000100:00100000:0.0:1788574045.389765:0:5885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.389791:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558016 00000100:00100000:0.0:1788574045.389797:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558016 00000100:00100000:0.0:1788574045.389833:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574045.389840:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e1dba9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:5885:x1875455747558016:12345-0@lo:502: 00000100:00100000:0.0:1788574045.390238:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e1dba9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:5885:x1875455747558016:12345-0@lo:502: Request processed in 398us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574045.390246:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574045.390279:0:5885:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d84bdc29 going to sleep for 11 seconds 00000100:00100000:0.0:1788574045.390301:0:5885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000551a9dca pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:5885:1875455747558016:0@lo:502: 00000040:00080000:0.0:1788574045.390325:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788574045.390532:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747557888 00000100:00100000:2.0:1788574045.390538:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747557888 00000100:00100000:2.0:1788574045.390560:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574045.390564:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bdff713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747557888:12345-0@lo:38: 00000100:00100000:2.0:1788574045.390606:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bdff713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747557888:12345-0@lo:38: Request processed in 42us (1357us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788574045.390618:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574045.390650:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574045.390656:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000d6e9621e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574045.390659:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788574045.390662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046fde568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747557888:0@lo:38: 00000020:01000000:2.0:1788574045.390877:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788574045.390899:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574045.390919:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574045.390930:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 0000000038a842df/0x10531a153b535678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574045.390990:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788574045.390992:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574045.390993:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574045.390994:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574045.390996:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574045.390997:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574045.390998:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574045.391000:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574045.391001:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574045.391003:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574045.391004:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574045.391006:0:5838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574045.391009:0:5838:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788574045.391012:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574045.391013:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574045.391014:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574045.391015:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574045.391016:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574045.391017:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574045.391018:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574045.391034:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574045.391035:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574045.391036:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574045.391037:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574045.391037:0:5838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574045.391065:0:5838:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788574045.391077:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046fde568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747558144:0@lo:253: 00000100:00100000:2.0:1788574045.391110:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574045.391136:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039e25aab going to sleep for 11 seconds 00000100:00100000:0.0:1788574045.391410:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558144 00000100:00100000:0.0:1788574045.391415:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558144 00000100:00100000:0.0:1788574045.391454:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574045.391461:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008433fd49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5838:x1875455747558144:12345-0@lo:253: 20000000:01000000:0.0:1788574045.391483:0:5851:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788574045.391495:0:5851:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788574045.428929:0:5851:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788574045.428947:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788574045.429071:0:5873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788574045.429075:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788574045.429095:0:5873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.429114:0:5873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53565c expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.429121:0:5873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.429158:0:5873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53565c expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574045.429172:0:5873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53565c expref: 12 pid: 5849 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574045.429185:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000164cb6bf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1875455747558272:0@lo:104: 00000100:00100000:3.0:1788574045.429245:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.429294:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d900f0ce going to sleep for 11 seconds 00000100:00100000:0.0:1788574045.429350:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558272 00000100:00100000:0.0:1788574045.429357:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558272 00000100:00100000:0.0:1788574045.429436:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574045.429445:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3005b7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5873:x1875455747558272:12345-0@lo:104: 00010000:00010000:0.0:1788574045.429458:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429525:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574045.429531:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3005b7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5873:x1875455747558272:12345-0@lo:104: Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574045.429538:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788574045.429561:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574045.429566:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429573:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000077e65b7f already unused, calling callback (00000000eef9d5aa) 10000000:00010000:0.0:1788574045.429576:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429584:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574045.429589:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574045.429595:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574045.429623:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429629:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574045.429645:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429651:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: 0000000077e65b7f/0x10531a153b53565c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535663 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429678:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574045.429680:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574045.429681:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574045.429740:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000551a9dca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747558400:0@lo:103: 00000100:00100000:0.0:1788574045.429768:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.429826:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558400 00000100:00100000:0.0:1788574045.429830:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558400 00010000:00010000:0.0:1788574045.429844:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53565c expref: 13 pid: 5849 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574045.429862:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574045.429866:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052cd5db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+13:3313:x1875455747558400:12345-0@lo:103: 00010000:00010000:0.0:1788574045.429874:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574045.429877:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53565c expref: 13 pid: 5849 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429885:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53565c expref: 13 pid: 5849 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429899:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429906:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788574045.429918:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000843381s 00010000:00010000:0.0:1788574045.429922:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429938:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.429945:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430025:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430031:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000129c9b7b already unused, calling callback (00000000317dfd86) 00010000:00010000:0.0:1788574045.430034:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430040:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430048:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430056:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574045.430082:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052cd5db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+13:3313:x1875455747558400:12345-0@lo:103: Request processed in 216us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574045.430088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574045.430123:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000551a9dca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747558400:0@lo:103: 00010000:00010000:0.0:1788574045.430145:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094e4a4df/0x10531a153b535663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53565c expref: 12 pid: 5849 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574045.430153:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000164cb6bf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1875455747558272:0@lo:104: 00010000:00010000:0.0:1788574045.430163:0:5873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430176:0:5873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430181:0:5873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574045.430186:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000129c9b7b/0x10531a153b535694 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574045.439501:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008433fd49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:5838:x1875455747558144:12345-0@lo:253: Request processed in 48031us (48381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574045.439520:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574045.439635:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046fde568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:5838:1875455747558144:0@lo:253: 10000000:01000000:1.0:1788574045.439650:0:5838:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788574045.439653:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574045.439655:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788574045.439656:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574045.439673:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574045.439674:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574045.439676:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574045.439677:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574045.439679:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788574045.439680:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788574045.439681:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788574045.439683:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574045.439684:0:5838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788574045.439700:0:5838:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788574045.447105:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.447559:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574045.447779:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.448021:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574045.448278:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.448549:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574045.449589:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.449804:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574045.450355:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.450662:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574045.450873:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574045.451356:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788574045.501055:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1788574045.508900:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788574045.535690:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788574045.535960:0:5891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788574045.538791:0:5890:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788574045.538800:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788574045.540742:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788574045.540948:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788574045.541712:0:5838:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788574045.541724:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788574045.541878:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574045.545465:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788574045.546522:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788574045.546577:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788574045.546902:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788574045.547836:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788574045.550062:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788574045.550309:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788574045.550502:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788574045.550653:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788574045.550782:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788574045.550929:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788574045.551502:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788574045.551662:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788574045.551837:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788574045.552006:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788574045.552159:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788574045.552517:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788574045.552657:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788574045.552825:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788574045.553114:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788574045.553452:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788574045.553754:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788574045.553912:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788574045.554199:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788574045.554508:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788574045.554660:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788574045.554814:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788574045.554945:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788574045.555477:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788574045.555629:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788574045.555805:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788574045.555944:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788574045.556498:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788574045.556640:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788574045.556826:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788574045.557098:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788574045.557332:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788574045.560668:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788574045.591349:0:5891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788574045.638154:0:5838:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788574045.638192:0:5838:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3a24197f988 00100000:10000000:2.0:1788574045.638200:0:5838:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788574045.639300:0:5838:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574045.639315:0:5838:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574045.639333:0:5838:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788574045.639349:0:5838:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788574045.695463:0:5891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788574045.695549:0:5891:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788574045.695554:0:5891:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788574046.529559:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574047.552588:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574048.581106:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574049.609041:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574050.123725:0:6134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788574050.439510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788574050.439519:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788574050.439522:0:37:0:(import.c:65:import_set_state_nolock()) 00000000d6e9621e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574050.439535:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d6e9621e using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574050.439557:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eb391833 x1875455747558656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574050.439606:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb391833 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747558656:0@lo:38: 00000100:00100000:2.0:1788574050.439676:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574050.443142:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574050.443174:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a517d23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747558528:0@lo:400: 00000100:00100000:0.0:1788574050.444348:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574050.444757:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558656 00000100:00100000:1.0:1788574050.444770:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558656 00000100:00100000:1.0:1788574050.445895:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574050.445906:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f47c3b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875455747558656:12345-0@lo:38: 00010000:00080000:1.0:1788574050.445948:0:5859:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1788574050.445986:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x10531a153b53569b 00000004:00100000:1.0:1788574050.446034:0:5859:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788574050.446156:0:5859:0:(import.c:65:import_set_state_nolock()) 00000000471b3a1e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574050.446258:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f47c3b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875455747558656:12345-0@lo:38: Request processed in 350us (6581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574050.446266:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574050.446830:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558528 00000100:00100000:3.0:1788574050.446840:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558528 00000100:00100000:3.0:1788574050.446895:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574050.446902:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e6402fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+11:3315:x1875455747558528:12345-0@lo:400: 00000100:00100000:3.0:1788574050.446955:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e6402fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+11:3315:x1875455747558528:12345-0@lo:400: Request processed in 54us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574050.446961:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574050.447025:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a517d23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747558528:0@lo:400: 00010000:00080000:3.0:1788574050.449728:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eb391833 x1875455747558656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574050.449752:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788574050.449759:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788574050.449764:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788574050.449768:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000d6e9621e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788574050.449774:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb391833 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747558656:0@lo:38: 00010000:00010000:1.0:1788574050.624678:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788574051.456452:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574051.456462:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a790a3d000 from 3 10000000:01000000:0.0:1788574051.456468:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574051.456511:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574051.456525:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574051.456537:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574051.456560:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000551a9dca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747558784:0@lo:101: 00000100:00100000:0.0:1788574051.456641:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574051.456696:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000025e3d4e going to sleep for 11 seconds 00000100:00100000:2.0:1788574051.457974:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558784 00000100:00100000:2.0:1788574051.457989:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558784 00000100:00100000:2.0:1788574051.458040:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574051.458047:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b10412e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:5854:x1875455747558784:12345-0@lo:101: 00010000:00010000:2.0:1788574051.458064:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574051.458081:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b118982/0x10531a153b5356a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5356a2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574051.458106:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b118982/0x10531a153b5356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5356a2 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574051.458116:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b118982/0x10531a153b5356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356a2 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574051.458125:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b118982, rc 0) 00000100:00100000:2.0:1788574051.458180:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b10412e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747558784:12345-0@lo:101: Request processed in 133us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574051.458186:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574051.458231:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000551a9dca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747558784:0@lo:101: 00010000:00010000:2.0:1788574051.458244:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574051.458252:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574051.458329:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d73a20ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747558912:0@lo:256: 00000100:00100000:2.0:1788574051.458361:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574051.458395:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039e25aab going to sleep for 11 seconds 00000100:00100000:3.0:1788574051.459907:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747558912 00000100:00100000:3.0:1788574051.459927:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747558912 00000100:00100000:3.0:1788574051.459985:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574051.459994:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fa13710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747558912:12345-0@lo:256: 20000000:01000000:3.0:1788574051.460018:0:5852:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574051.460039:0:5852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574051.460042:0:5852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788574051.460159:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fa13710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747558912:12345-0@lo:256: Request processed in 166us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574051.460166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574051.460218:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d73a20ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747558912:0@lo:256: 10000000:01000000:3.0:1788574051.460278:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574051.460579:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574051.460591:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 00000000524da75f/0x10531a153b5356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574051.658342:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574052.674956:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574053.710048:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574054.720585:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574055.335895:0:6337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc76b38d30 20000000:00000080:0.0:1788574055.335913:0:6337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a79b0fd000 uarg=0000000000000000 20000000:01000000:0.0:1788574055.335946:0:6337:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788574055.335953:0:6337:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788574055.335958:0:6337:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788574055.336143:0:6337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788574055.336154:0:6337:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788574055.343751:0:6337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574055.344019:0:6337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788574055.344079:0:6337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788574055.344125:0:6337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788574055.344143:0:6337:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574055.344161:0:6337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574055.344180:0:6337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53566a expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574055.344187:0:6337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574055.344230:0:6337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53566a expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574055.344245:0:6337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53566a expref: 11 pid: 5849 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574055.344271:0:6337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6337:1875455747559040:0@lo:104: 00000100:00100000:1.0:1788574055.344335:0:6337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574055.344767:0:6337:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d8d7010 going to sleep for 11 seconds 00000100:00100000:3.0:1788574055.344846:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559040 00000100:00100000:3.0:1788574055.344855:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559040 00000100:00100000:3.0:1788574055.344910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574055.344918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d02307 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:6337:x1875455747559040:12345-0@lo:104: 00010000:00010000:3.0:1788574055.344933:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574055.344999:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574055.345004:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d02307 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:6337:x1875455747559040:12345-0@lo:104: Request processed in 88us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574055.345011:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574055.345119:0:6337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6337:1875455747559040:0@lo:104: 00010000:00010000:1.0:1788574055.345139:0:6337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574055.345184:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574055.345190:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574055.345197:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003fc7bd37 already unused, calling callback (00000000eef9d5aa) 10000000:00010000:2.0:1788574055.345201:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574055.345209:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574055.345215:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574055.345220:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574055.345269:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574055.345275:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574055.345303:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574055.345310:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: 000000003fc7bd37/0x10531a153b53566a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535671 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574055.345328:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574055.345330:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574055.345331:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574055.345339:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574055.345351:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000061690612 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747559168:0@lo:103: 00000100:00100000:2.0:1788574055.345528:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574055.345636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559168 00000100:00100000:0.0:1788574055.345641:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559168 00010000:00010000:0.0:1788574055.345660:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53566a expref: 12 pid: 5849 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574055.345682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574055.345687:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000221ac6c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+12:3314:x1875455747559168:12345-0@lo:103: 00010000:00010000:0.0:1788574055.345697:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574055.345701:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53566a expref: 12 pid: 5849 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345710:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53566a expref: 12 pid: 5849 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345723:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df420bb2/0x10531a153b535671 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53566a expref: 12 pid: 5849 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345735:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345741:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345758:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345764:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345769:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345774:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345779:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f40a6d46 already unused, calling callback (00000000317dfd86) 00010000:00010000:0.0:1788574055.345782:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345789:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345798:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574055.345807:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574055.345838:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000221ac6c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+11:3314:x1875455747559168:12345-0@lo:103: Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574055.345844:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574055.345874:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000061690612 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747559168:0@lo:103: 00010000:00010000:1.0:1788574055.346035:0:6337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574055.346042:0:6337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574055.346055:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f40a6d46/0x10531a153b5356b0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574055.555696:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f90209bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747559296:0@lo:400: 00000100:00100000:0.0:1788574055.555796:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574055.555889:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559296 00000100:00100000:0.0:1788574055.555897:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559296 00000100:00100000:0.0:1788574055.555945:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574055.555954:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cd2f234 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747559296:12345-0@lo:400: 00000100:00100000:0.0:1788574055.556006:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cd2f234 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747559296:12345-0@lo:400: Request processed in 53us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574055.556013:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788574055.556052:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f90209bb x1875455747559296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574055.556066:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f90209bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747559296:0@lo:400: 00010000:00010000:1.0:1788574055.744688:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574056.769163:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574057.792578:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574058.816583:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574059.843861:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574060.672795:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574060.672823:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ead894ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747559424:0@lo:400: 00000100:00100000:2.0:1788574060.672901:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574060.672969:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cf648a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747559552:0@lo:400: 00000100:00100000:2.0:1788574060.672997:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788574060.674245:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574060.674254:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a790a3d000 from 1 10000000:01000000:2.0:1788574060.674259:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574060.674310:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000061f2ab29/0x10531a153b5356b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574060.674323:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000061f2ab29/0x10531a153b5356b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574060.674335:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000061f2ab29/0x10531a153b5356b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574060.674356:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a47ad52b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747559680:0@lo:101: 00000100:00100000:2.0:1788574060.674431:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574060.674467:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000594f257b going to sleep for 11 seconds 00000100:00100000:3.0:1788574060.674528:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559424 00000100:00100000:3.0:1788574060.674537:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559424 00000100:00100000:3.0:1788574060.674586:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559680 00000100:00100000:3.0:1788574060.674590:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559680 00000100:00100000:3.0:1788574060.674606:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574060.674613:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4ffcec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:3312:x1875455747559424:12345-0@lo:400: 00000100:00100000:3.0:1788574060.674668:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4ffcec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:3312:x1875455747559424:12345-0@lo:400: Request processed in 56us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.674675:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574060.674856:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574060.674866:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f59d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:5854:x1875455747559680:12345-0@lo:101: 00010000:00010000:0.0:1788574060.674874:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574060.674888:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df420bb2/0x10531a153b5356be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5356b7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574060.674910:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df420bb2/0x10531a153b5356be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5356b7 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574060.674920:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df420bb2/0x10531a153b5356be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356b7 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574060.674929:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df420bb2, rc 0) 00000100:00100000:0.0:1788574060.674957:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f59d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747559680:12345-0@lo:101: Request processed in 94us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574060.674963:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788574060.675053:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a47ad52b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747559680:0@lo:101: 00010000:00010000:1.0:1788574060.675067:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000061f2ab29/0x10531a153b5356b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574060.675075:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000061f2ab29/0x10531a153b5356b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574060.675126:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747559808:0@lo:501: 00000100:00100000:1.0:1788574060.675154:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.675187:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eaf40c07 going to sleep for 11 seconds 00000100:00100000:0.0:1788574060.675290:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559808 00000100:00100000:0.0:1788574060.675295:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559808 00000100:00100000:0.0:1788574060.675316:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574060.675321:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7127eb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747559808:12345-0@lo:501: 00000100:00100000:0.0:1788574060.675612:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7127eb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747559808:12345-0@lo:501: Request processed in 290us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574060.675619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788574060.675932:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559552 00000100:00100000:3.0:1788574060.675945:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559552 00000100:00100000:3.0:1788574060.675988:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574060.675995:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874ceb14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747559552:12345-0@lo:400: 00000100:00100000:1.0:1788574060.676134:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747559808:0@lo:501: 00000100:00100000:1.0:1788574060.676183:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747559936:0@lo:503: 00010000:00080000:2.0:1788574060.676765:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005cf648a5 x1875455747559552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574060.676779:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cf648a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747559552:0@lo:400: 00000100:00100000:2.0:1788574060.679651:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ead894ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747559424:0@lo:400: 00000100:00100000:1.0:1788574060.684003:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.684060:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747559936 00000100:00100000:1.0:1788574060.684069:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747559936 00000100:00100000:1.0:1788574060.684106:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574060.684113:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcc7fa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747559936:12345-0@lo:503: 00000100:00100000:1.0:1788574060.684343:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcc7fa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747559936:12345-0@lo:503: Request processed in 230us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.684353:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574060.684430:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eaf40c07 going to sleep for 11 seconds 00000100:00100000:1.0:1788574060.684454:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9a13087 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747559936:0@lo:503: 00000100:00100000:3.0:1788574060.685268:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874ceb14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747559552:12345-0@lo:400: Request processed in 9271us (12267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.685279:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574060.688093:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f3d1c83 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6676:1875455747560064:0@lo:502: 00000100:00100000:3.0:1788574060.688184:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574060.688263:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set 00000000073a55c1 going to sleep for 11 seconds 00000100:00100000:0.0:1788574060.688305:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560064 00000100:00100000:0.0:1788574060.688313:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560064 00000100:00100000:0.0:1788574060.688495:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574060.688504:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a3a343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:6676:x1875455747560064:12345-0@lo:502: 00000100:00100000:0.0:1788574060.688779:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a3a343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:6676:x1875455747560064:12345-0@lo:502: Request processed in 275us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574060.688786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574060.690734:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f3d1c83 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6676:1875455747560064:0@lo:502: 00000020:01000000:3.0:1788574060.690789:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574060.690805:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574060.690807:0:6676:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788574060.690817:0:6676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a790a3d000 00000020:00000080:3.0:1788574060.690820:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574060.690894:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6676:1875455747560192:0@lo:502: 00000100:00100000:3.0:1788574060.691184:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574060.691221:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574060.691299:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560192 00000100:00100000:1.0:1788574060.691305:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560192 00000100:00100000:1.0:1788574060.691365:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574060.691399:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:6676:x1875455747560192:12345-0@lo:502: 00000100:00100000:1.0:1788574060.691616:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:6676:x1875455747560192:12345-0@lo:502: Request processed in 218us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.691625:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574060.691729:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6676:1875455747560192:0@lo:502: 00000020:01000000:3.0:1788574060.691754:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574060.691759:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574060.691760:0:6676:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788574060.691765:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788574060.692398:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788574060.692419:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574060.692430:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574060.692444:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574060.865328:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788574061.589316:0:6708:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788574061.589321:0:6708:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788574061.589487:0:6708:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a785e1b800 00000020:01000004:0.0:1788574061.589507:0:6708:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788574061.589519:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788574061.589532:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a7924199c0) 00000020:00000080:0.0:1788574061.589549:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788574061.601529:0:6708:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788574061.601824:0:6708:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788574061.620331:0:6708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788574061.625859:0:6708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788574061.625898:0:6708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788574061.626976:0:6708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788574061.626999:0:6708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788574061.627581:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788574061.627592:0:6708:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788574061.627604:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x10531a153b5356cc 00000020:01000004:2.0:1788574061.627614:0:6708:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788574061.627640:0:6708:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788574061.627644:0:6708:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788574061.627650:0:6708:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788574061.627654:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788574061.627666:0:6708:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a79b180000) 00000020:00000080:2.0:1788574061.627728:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788574061.628975:0:6708:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574061.629328:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574061.629336:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788574061.632785:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574061.632800:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788574061.633277:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574061.633284:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788574061.634608:0:6708:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574061.634838:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788574061.634852:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788574061.636429:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574061.636440:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788574061.686533:0:6708:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574061.686988:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574061.686997:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788574061.688870:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788574061.688886:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788574061.690809:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574061.690824:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788574061.694247:0:6708:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574061.694859:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788574061.694868:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788574061.695504:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788574061.695512:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788574061.778129:0:6708:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574061.779364:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574061.779400:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788574061.781020:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788574061.781033:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788574061.782022:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788574061.782050:0:6708:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788574061.782057:0:6708:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788574061.836720:0:6708:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788574061.836765:0:6708:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788574061.836769:0:6708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788574061.836776:0:6708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574061.836778:0:6708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574061.836779:0:6708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574061.836780:0:6708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574061.836781:0:6708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574061.836782:0:6708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574061.836784:0:6708:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574061.836785:0:6708:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574061.836787:0:6708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574061.836788:0:6708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574061.836793:0:6708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788574061.836795:0:6708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574061.836796:0:6708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574061.836797:0:6708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574061.836798:0:6708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574061.836799:0:6708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574061.836800:0:6708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574061.836801:0:6708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574061.836802:0:6708:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574061.836803:0:6708:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574061.836804:0:6708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574061.836805:0:6708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574061.836836:0:6708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788574061.836856:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747560320:0@lo:253: 00000100:00100000:2.0:1788574061.836935:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574061.843901:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574061.844709:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560320 00000100:00100000:1.0:1788574061.844721:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560320 00000100:00100000:1.0:1788574061.844782:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574061.844794:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747560320:12345-0@lo:253: 20000000:01000000:1.0:1788574061.844844:0:5852:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788574061.844848:0:5852:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788574061.844854:0:5852:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788574061.844857:0:5852:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788574061.847136:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574061.847420:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788574061.847436:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788574061.847479:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788574061.847487:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788574061.847516:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788574061.847568:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788574061.849582:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788574061.849705:0:5852:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:1.0:1788574061.849708:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:1.0:1788574061.849747:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788574061.849756:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788574061.850110:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788574061.850120:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:1.0:1788574061.850177:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788574061.850188:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788574061.850230:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788574061.850287:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788574061.853100:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788574061.853139:0:5852:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:1.0:1788574061.853151:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:1.0:1788574061.853258:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788574061.853268:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788574061.853305:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788574061.853313:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:1.0:1788574061.853360:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788574061.853767:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788574061.853830:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788574061.853871:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788574061.853891:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788574061.853894:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788574061.853898:0:5852:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788574061.853923:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788574061.853925:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788574061.853961:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788574061.853964:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788574061.857167:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788574061.857276:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788574061.857329:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788574061.857892:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788574061.857939:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788574061.858044:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788574061.858061:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788574061.858064:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788574061.862951:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788574061.863810:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788574061.863940:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788574061.864133:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788574061.864292:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788574061.864296:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788574061.865908:0:6726:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788574061.866085:0:6726:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788574061.866294:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788574061.871638:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788574061.871752:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788574061.871794:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788574061.871997:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788574061.872001:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788574061.872009:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788574061.872533:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872554:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5355ec expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872564:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535608 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872570:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535678 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872579:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872633:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535678 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872649:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535678 expref: 12 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.872663:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5852:1875455747560448:0@lo:104: 00000100:00100000:0.0:1788574061.872735:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574061.872985:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535608 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.872993:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535608 expref: 12 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.873025:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5852:1875455747560576:0@lo:104: 00000100:00100000:0.0:1788574061.873051:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574061.874243:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5355ec expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.874259:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5355ec expref: 12 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.874269:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5852:1875455747560704:0@lo:104: 00000100:00100000:0.0:1788574061.874310:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574061.874561:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560448 00000100:00100000:2.0:1788574061.874569:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560448 00000100:00100000:2.0:1788574061.877136:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560576 00000100:00100000:2.0:1788574061.877568:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560576 00000100:00100000:2.0:1788574061.877735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574061.877747:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+4:5852:x1875455747560448:12345-0@lo:104: 00010000:00010000:2.0:1788574061.877779:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.877974:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574061.877981:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+4:5852:x1875455747560448:12345-0@lo:104: Request processed in 237us (5246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.877990:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574061.878023:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574061.878029:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5852:x1875455747560576:12345-0@lo:104: 00010000:00010000:2.0:1788574061.878038:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.878411:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a09403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574061.878443:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5852:1875455747560448:0@lo:104: 00000100:00100000:0.0:1788574061.878454:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5852:1875455747560576:0@lo:104: 00010000:00010000:1.0:1788574061.878789:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574061.878798:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.878806:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574061.878811:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.878936:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574061.878945:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574061.878950:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574061.879039:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.879046:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574061.879066:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.879084:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53567f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.879098:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574061.879102:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.879107:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574061.879110:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.879118:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574061.879124:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574061.879130:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574061.879182:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788574061.879200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5852:x1875455747560576:12345-0@lo:104: Request processed in 1161us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.879209:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574061.879235:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560704 00000100:00100000:2.0:1788574061.879242:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560704 00000100:00100000:2.0:1788574061.879270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574061.879277:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5852:x1875455747560704:12345-0@lo:104: 00010000:00010000:2.0:1788574061.879286:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.879336:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574061.879341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5852:x1875455747560704:12345-0@lo:104: Request processed in 66us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.879347:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788574061.879808:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788574061.880124:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5852:1875455747560704:0@lo:104: 00010000:00010000:3.0:1788574061.880324:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574061.880334:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.880342:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031a00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574061.880346:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.880355:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574061.880362:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574061.880393:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574061.880447:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.880764:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.880772:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574061.880802:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.880810:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780031000/0x10531a153b535608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53560f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.880832:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574061.880842:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574061.880844:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574061.880861:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747560832:0@lo:103: 00000100:00100000:1.0:1788574061.880915:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574061.880968:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574061.880976:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747560960:0@lo:103: 00000100:00100000:1.0:1788574061.880999:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574061.881430:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560832 00000100:00100000:1.0:1788574061.881438:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560832 00010000:00010000:1.0:1788574061.881469:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535678 expref: 13 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574061.881504:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747560960 00000100:00100000:1.0:1788574061.881508:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747560960 00010000:00010000:1.0:1788574061.881519:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535608 expref: 14 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574061.881533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574061.881541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+14:3315:x1875455747560832:12345-0@lo:103: 00010000:00010000:1.0:1788574061.881553:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574061.881558:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535678 expref: 14 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.881569:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535678 expref: 14 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.881597:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b800/0x10531a153b53567f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535678 expref: 14 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.881616:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574061.881660:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+13:3315:x1875455747560832:12345-0@lo:103: Request processed in 120us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574061.881787:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574061.881819:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574061.881826:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+12:3313:x1875455747560960:12345-0@lo:103: 00010000:00010000:1.0:1788574061.881834:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574061.881839:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535608 expref: 12 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.881847:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535608 expref: 12 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.881857:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165ba00/0x10531a153b53560f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535608 expref: 12 pid: 5852 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.881866:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574061.881894:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+11:3313:x1875455747560960:12345-0@lo:103: Request processed in 68us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574061.881900:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574061.881935:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747560960:0@lo:103: 00000100:00100000:1.0:1788574061.881963:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747560832:0@lo:103: 00010000:00010000:3.0:1788574061.882578:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.885393:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574061.885402:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574061.885579:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574061.885618:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.885627:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5355ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5355f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.885655:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574061.885757:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747561088:0@lo:103: 00000100:00100000:1.0:1788574061.885836:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574061.885909:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561088 00000100:00100000:1.0:1788574061.885917:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561088 00010000:00010000:1.0:1788574061.885949:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5355ec expref: 11 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574061.885993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574061.886002:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+11:3313:x1875455747561088:12345-0@lo:103: 00010000:00010000:1.0:1788574061.886159:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574061.886165:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5355ec expref: 11 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886177:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5355ec expref: 11 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a200/0x10531a153b5355f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5355ec expref: 11 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886335:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886345:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886364:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886393:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886400:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886407:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886426:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574061.886431:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886440:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886457:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886470:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574061.886509:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+10:3313:x1875455747561088:12345-0@lo:103: Request processed in 508us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574061.886516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574061.886559:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747561088:0@lo:103: 00010000:00010000:1.0:1788574061.886583:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886590:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574061.886596:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a780030200/0x10531a153b5356da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788574061.886609:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788574061.886781:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574061.886783:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574061.889770:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574061.969439:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+9:6708:x1875455747560320:12345-0@lo:253: Request processed in 124633us (132490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.969459:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574061.973838:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747560320:0@lo:253: 10000000:01000000:0.0:1788574061.973861:0:6708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788574061.973866:0:6708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574061.973868:0:6708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574061.973870:0:6708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574061.973871:0:6708:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788574061.973872:0:6708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574061.973873:0:6708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574061.973875:0:6708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574061.973877:0:6708:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788574061.973879:0:6708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574061.973880:0:6708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574061.973907:0:6708:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a785e1b800 from lustre-OST0000 10000000:01000000:0.0:1788574061.973936:0:6708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788574061.973939:0:6708:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788574061.973947:0:6708:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a792418000 local copy 10000000:01000000:0.0:1788574061.973968:0:6708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788574061.974015:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.974028:0:6708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.974038:0:6708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.974059:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561216:0@lo:101: 00000100:00100000:0.0:1788574061.974136:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.974312:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574061.976832:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561216 00000100:00100000:3.0:1788574061.976847:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561216 00000100:00100000:3.0:1788574061.976971:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574061.976982:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+9:6708:x1875455747561216:12345-0@lo:101: 00010000:00010000:3.0:1788574061.976997:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574061.977016:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a400/0x10531a153b5356e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5356e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.977043:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a400/0x10531a153b5356e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5356e1 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.977056:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a400/0x10531a153b5356e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356e1 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.977065:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a400, rc 0) 00000100:00100000:3.0:1788574061.977133:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+10:6708:x1875455747561216:12345-0@lo:101: Request processed in 153us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574061.977151:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574061.977246:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561216:0@lo:101: 00010000:00010000:0.0:1788574061.977264:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.977275:0:6708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.977408:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561344:0@lo:501: 00000100:00100000:0.0:1788574061.977439:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.980090:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574061.987295:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561344 00000100:00100000:2.0:1788574061.987313:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561344 00000100:00100000:2.0:1788574061.987405:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574061.987420:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+10:6708:x1875455747561344:12345-0@lo:501: 00000100:00100000:2.0:1788574061.988020:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+10:6708:x1875455747561344:12345-0@lo:501: Request processed in 601us (10578us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574061.988030:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574061.991596:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561344:0@lo:501: 10000000:01000000:0.0:1788574061.991630:0:6708:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788574061.991709:0:6708:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788574061.991720:0:6708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.991750:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.991759:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.991777:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788574061.991800:0:6708:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a785e1b800 10000000:01000000:0.0:1788574061.991806:0:6708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788574061.991811:0:6708:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a792418000 10000000:01000000:0.0:1788574061.991814:0:6708:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788574061.991817:0:6708:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a792418000 from 1 10000000:01000000:0.0:1788574061.991820:0:6708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788574061.991853:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.991861:0:6708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.991873:0:6708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.991893:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561472:0@lo:101: 00000100:00100000:0.0:1788574061.991959:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.992012:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574061.992169:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561472 00000100:00100000:3.0:1788574061.992178:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561472 00000100:00100000:3.0:1788574061.992232:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574061.992243:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+10:6708:x1875455747561472:12345-0@lo:101: 00010000:00010000:3.0:1788574061.992256:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574061.992269:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165ae00/0x10531a153b5356f6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5356ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.992294:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165ae00/0x10531a153b5356f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5356ef expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.992317:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165ae00/0x10531a153b5356f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356ef expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.992326:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165ae00, rc 0) 00000100:00100000:3.0:1788574061.992364:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747561472:12345-0@lo:101: Request processed in 123us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574061.992398:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1788574061.992496:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574061.992505:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.992512:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574061.992516:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.992525:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574061.992532:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574061.992550:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574061.992571:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.992578:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574061.992608:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.992616:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b5356e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x10531a153b5356e8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.992634:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574061.992636:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574061.992638:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574061.992646:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574061.992657:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747561600:0@lo:103: 00000100:00100000:2.0:1788574061.992697:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574061.992734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561600 00000100:00100000:2.0:1788574061.992738:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561600 00000100:00100000:2.0:1788574061.992769:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574061.992776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+11:3315:x1875455747561600:12345-0@lo:103: 00010000:00010000:2.0:1788574061.992785:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574061.992795:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a400/0x10531a153b5356e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b5356e1 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574061.992806:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574061.992830:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+10:3315:x1875455747561600:12345-0@lo:103: Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.992845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574061.992878:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747561600:0@lo:103: 00000100:00100000:0.0:1788574061.994025:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561472:0@lo:101: 00010000:00010000:0.0:1788574061.994055:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.994082:0:6708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574061.994101:0:6708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788574061.994120:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.994127:0:6708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574061.994135:0:6708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788574061.994150:0:6708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574061.994155:0:6708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788574061.994158:0:6708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574061.994186:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.994193:0:6708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.994202:0:6708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.994217:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561728:0@lo:101: 00000100:00100000:0.0:1788574061.994259:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.994286:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574061.994399:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561728 00000100:00100000:3.0:1788574061.994407:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561728 00000100:00100000:3.0:1788574061.994442:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574061.994451:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+10:6708:x1875455747561728:12345-0@lo:101: 00010000:00010000:3.0:1788574061.994463:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574061.994475:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5356fd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.994494:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5356fd expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.994504:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356fd expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574061.994512:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a800, rc 0) 00000100:00100000:3.0:1788574061.994549:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747561728:12345-0@lo:101: Request processed in 97us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574061.994555:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788574061.994642:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561728:0@lo:101: 00010000:00010000:0.0:1788574061.994658:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574061.994752:0:6708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574061.994854:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561856:0@lo:501: 00000100:00100000:0.0:1788574061.994880:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.994911:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574061.994966:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561856 00000100:00100000:3.0:1788574061.994970:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561856 00000100:00100000:3.0:1788574061.994998:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574061.995010:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747561856:12345-0@lo:501: 00000100:00100000:3.0:1788574061.995248:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747561856:12345-0@lo:501: Request processed in 238us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574061.995256:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574061.995353:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561856:0@lo:501: 00000100:00100000:0.0:1788574061.995412:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561984:0@lo:503: 00000100:00100000:0.0:1788574061.995450:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.995460:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574061.995852:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747561984 00000100:00100000:3.0:1788574061.995857:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747561984 00000100:00100000:3.0:1788574061.995889:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788574061.995897:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747561984:12345-0@lo:503: 00000100:00100000:3.0:1788574061.996056:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747561984:12345-0@lo:503: Request processed in 159us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574061.996064:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574061.996173:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747561984:0@lo:503: 00000040:00080000:0.0:1788574061.996550:0:6708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574061.996628:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562112:0@lo:502: 00000100:00100000:0.0:1788574061.997498:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574061.997588:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0940cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.002797:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562112 00000100:00100000:3.0:1788574062.002816:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562112 00000100:00100000:0.0:1788574062.006112:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574062.006124:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747562112:12345-0@lo:502: 00000100:00100000:0.0:1788574062.006481:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747562112:12345-0@lo:502: Request processed in 357us (9812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.006489:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574062.006650:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562112:0@lo:502: 00000040:00080000:1.0:1788574062.006951:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788574062.007016:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788574062.007049:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788574062.007094:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788574062.007127:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788574062.007173:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788574062.007214:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562240:0@lo:502: 00000100:00100000:1.0:1788574062.007268:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.007320:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.007489:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562240 00000100:00100000:0.0:1788574062.007496:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562240 00000100:00100000:0.0:1788574062.007542:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574062.007550:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747562240:12345-0@lo:502: 00000100:00100000:0.0:1788574062.007721:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747562240:12345-0@lo:502: Request processed in 170us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.007728:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574062.007942:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562240:0@lo:502: 00000040:00080000:1.0:1788574062.008040:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788574062.008052:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788574062.009978:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574062.009990:0:6730:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788574062.009997:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574062.009999:0:6730:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788574062.010006:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574062.010022:0:6730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a79241b380) 00000020:00000080:0.0:1788574062.010046:0:6730:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788574062.010052:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788574062.010128:0:6730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a785e1b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788574062.010147:0:6730:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788574062.010157:0:6730:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x10531a153b535712 00010000:00010000:0.0:1788574062.015963:0:6730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788574062.022183:0:6730:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788574062.028471:0:6730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788574062.029029:0:6730:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788574062.043157:0:6730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788574062.043662:0:6730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788574062.058300:0:6730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788574062.058313:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574062.058319:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574062.058321:0:6730:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788574062.058324:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574062.058328:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574062.058334:0:6730:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574062.058337:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574062.058339:0:6730:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788574062.058428:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574062.058432:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574062.058433:0:6730:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788574062.058437:0:6730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788574062.060255:0:6708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788574062.060300:0:6708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788574062.060327:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.060343:0:6708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574062.060352:0:6708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a785e1b800 from 1 10000000:01000000:1.0:1788574062.060355:0:6708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574062.060423:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.060432:0:6708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.060446:0:6708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.060474:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562368:0@lo:101: 00000100:00100000:1.0:1788574062.060582:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.060649:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.062907:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562368 00000100:00100000:2.0:1788574062.062923:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562368 00000100:00100000:2.0:1788574062.062995:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574062.063006:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+11:6708:x1875455747562368:12345-0@lo:101: 00010000:00010000:2.0:1788574062.063026:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574062.063045:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535719 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.063077:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535719 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.063090:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535719 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.063099:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159400, rc 0) 00000100:00100000:2.0:1788574062.063187:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562368:12345-0@lo:101: Request processed in 184us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.063193:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574062.063423:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562368:0@lo:101: 00010000:00010000:1.0:1788574062.063442:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.063451:0:6708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.063571:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562496:0@lo:501: 00000100:00100000:1.0:1788574062.063607:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.063651:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.063844:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562496 00000100:00100000:2.0:1788574062.063850:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562496 00000100:00100000:2.0:1788574062.063881:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574062.063887:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562496:12345-0@lo:501: 00000100:00100000:2.0:1788574062.064240:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562496:12345-0@lo:501: Request processed in 351us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.064246:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574062.070535:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562496:0@lo:501: 00000100:00100000:1.0:1788574062.070599:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562624:0@lo:503: 00000100:00100000:1.0:1788574062.070765:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.070856:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.075104:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562624 00000100:00100000:3.0:1788574062.075122:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562624 00000100:00100000:3.0:1788574062.075217:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574062.075227:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562624:12345-0@lo:503: 00000100:00100000:2.0:1788574062.083577:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562624:12345-0@lo:503: Request processed in 8340us (12800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.083593:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574062.085851:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562624:0@lo:503: 00000040:00080000:2.0:1788574062.086339:0:6708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574062.086477:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562752:0@lo:502: 00000100:00100000:2.0:1788574062.086555:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.086612:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.086802:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562752 00000100:00100000:0.0:1788574062.086810:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562752 00000100:00100000:0.0:1788574062.086855:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574062.086865:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562752:12345-0@lo:502: 00000100:00100000:0.0:1788574062.087095:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562752:12345-0@lo:502: Request processed in 230us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.087103:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574062.087364:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562752:0@lo:502: 00000040:00080000:2.0:1788574062.087648:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788574062.087781:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788574062.087811:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562880:0@lo:502: 00000100:00100000:2.0:1788574062.087860:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.087898:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.088081:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747562880 00000100:00100000:0.0:1788574062.088087:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747562880 00000100:00100000:0.0:1788574062.088124:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788574062.088132:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562880:12345-0@lo:502: 00000100:00100000:0.0:1788574062.088282:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747562880:12345-0@lo:502: Request processed in 151us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.088288:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574062.088435:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747562880:0@lo:502: 00000040:00080000:1.0:1788574062.088545:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788574062.088557:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788574062.089859:0:6734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574062.089871:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574062.089875:0:6734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788574062.089881:0:6734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a785e1b800 00000020:00000080:2.0:1788574062.089884:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574062.089904:0:6734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574062.089907:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574062.089909:0:6734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788574062.089912:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788574062.090146:0:6708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788574062.090169:0:6708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574062.090224:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.090234:0:6708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574062.090286:0:6708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788574062.090288:0:6708:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a785e1b800 10000000:01000000:1.0:1788574062.090292:0:6708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a785e1b800 10000000:01000000:1.0:1788574062.090296:0:6708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574062.090303:0:6708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a785e1b800 from 1 10000000:01000000:1.0:1788574062.090306:0:6708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574062.090338:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.090347:0:6708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.090360:0:6708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.090404:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563008:0@lo:101: 00000100:00100000:1.0:1788574062.090457:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.090495:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.090570:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563008 00000100:00100000:3.0:1788574062.090577:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563008 00000100:00100000:3.0:1788574062.090609:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574062.090618:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747563008:12345-0@lo:101: 00010000:00010000:3.0:1788574062.090630:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574062.090642:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535727 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.090779:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535727 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.090795:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535727 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.090805:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a400, rc 0) 00000100:00100000:3.0:1788574062.090851:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563008:12345-0@lo:101: Request processed in 233us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.090858:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574062.090926:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563008:0@lo:101: 00010000:00010000:1.0:1788574062.090939:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.090959:0:6708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.091036:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563136:0@lo:501: 00000100:00100000:1.0:1788574062.091061:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.091134:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.091283:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563136 00000100:00100000:0.0:1788574062.091289:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563136 00000100:00100000:0.0:1788574062.091352:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574062.091361:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563136:12345-0@lo:501: 00000100:00100000:0.0:1788574062.091646:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563136:12345-0@lo:501: Request processed in 285us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.091654:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574062.091801:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563136:0@lo:501: 00000100:00100000:1.0:1788574062.091832:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563264:0@lo:503: 00000100:00100000:1.0:1788574062.091870:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.092018:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7833c1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.092116:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563264 00000100:00100000:2.0:1788574062.092121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563264 00000100:00100000:2.0:1788574062.092156:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574062.092163:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563264:12345-0@lo:503: 00000100:00100000:2.0:1788574062.092319:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563264:12345-0@lo:503: Request processed in 155us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.092326:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574062.092556:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563264:0@lo:503: 00000040:00080000:1.0:1788574062.092876:0:6708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574062.092936:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563392:0@lo:502: 00000100:00100000:1.0:1788574062.093107:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.093131:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.093202:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563392 00000100:00100000:0.0:1788574062.093208:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563392 00000100:00100000:0.0:1788574062.093232:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574062.093239:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563392:12345-0@lo:502: 00000100:00100000:0.0:1788574062.093456:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563392:12345-0@lo:502: Request processed in 216us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.093462:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574062.093567:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563392:0@lo:502: 00000040:00080000:1.0:1788574062.093831:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788574062.093882:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788574062.093931:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788574062.094110:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788574062.094159:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788574062.094207:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788574062.094242:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788574062.094610:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788574062.094662:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788574062.094767:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788574062.094799:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788574062.094847:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788574062.094879:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788574062.094912:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788574062.095105:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788574062.095157:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788574062.095189:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788574062.095233:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788574062.095291:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788574062.095320:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788574062.095456:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788574062.095496:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788574062.095531:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788574062.095579:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788574062.095610:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788574062.095640:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788574062.095759:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788574062.095798:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788574062.095844:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563520:0@lo:502: 00000100:00100000:1.0:1788574062.095916:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.096096:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.096193:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563520 00000100:00100000:3.0:1788574062.096201:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563520 00000100:00100000:0.0:1788574062.096333:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574062.096346:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563520:12345-0@lo:502: 00000100:00100000:1.0:1788574062.097532:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563520:12345-0@lo:502: Request processed in 1184us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.097543:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574062.097637:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563520:0@lo:502: 00000040:00080000:2.0:1788574062.097808:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788574062.097822:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788574062.102556:0:6735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788574062.102575:0:6735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a7924bcd40) 00000020:00000080:1.0:1788574062.102597:0:6735:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788574062.102773:0:6735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a785e1b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788574062.102778:0:6735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a785e1b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788574062.102781:0:6735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a785e1b800 3 00010000:00080000:1.0:1788574062.102820:0:6735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6812f2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.157@tcp at head 00010000:00010000:1.0:1788574062.108644:0:6735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788574062.108873:0:6735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788574062.108911:0:6735:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574062.108928:0:6735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x10531a153b53573c 00000100:00080000:1.0:1788574062.108938:0:6735:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574062.108944:0:6735:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a6812f2000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574062.108979:0:6735:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bd10e680 x1875455747563648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574062.109023:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747563648:0@lo:38: 00000100:00100000:1.0:1788574062.109090:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.111428:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563648 00000100:00100000:0.0:1788574062.111449:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563648 00000100:00100000:0.0:1788574062.111518:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574062.111529:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875455747563648:12345-0@lo:38: 00010000:00080000:0.0:1788574062.111582:0:5859:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1788574062.111621:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x10531a153b535743 00000004:00100000:0.0:1788574062.111655:0:5859:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788574062.111699:0:5859:0:(import.c:65:import_set_state_nolock()) ffff90a7c1c1b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574062.111778:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875455747563648:12345-0@lo:38: Request processed in 250us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.111785:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788574062.113562:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7bd10e680 x1875455747563648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.113577:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574062.113587:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788574062.113595:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574062.113600:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574062.113603:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a6812f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574062.113609:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747563648:0@lo:38: 00000100:00080000:1.0:1788574062.113853:0:6735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788574062.118954:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574062.118980:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747563776:0@lo:400: 00000100:00100000:3.0:1788574062.119057:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.119118:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563776 00000100:00100000:3.0:1788574062.119127:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563776 00000100:00100000:3.0:1788574062.119188:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574062.119197:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747563776:12345-0@lo:400: 00000100:00100000:3.0:1788574062.119247:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747563776:12345-0@lo:400: Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.119261:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788574062.119312:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7bb28ce00 x1875455747563776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574062.119327:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747563776:0@lo:400: 00000040:00080000:1.0:1788574062.123483:0:6735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788574062.124243:0:6708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788574062.124276:0:6708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574062.124305:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.124318:0:6708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574062.124408:0:6708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788574062.124411:0:6708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574062.124412:0:6708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574062.124413:0:6708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574062.124415:0:6708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574062.124416:0:6708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574062.124417:0:6708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574062.124419:0:6708:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574062.124420:0:6708:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574062.124422:0:6708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574062.124423:0:6708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574062.124427:0:6708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788574062.124429:0:6708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574062.124431:0:6708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574062.124432:0:6708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574062.124433:0:6708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574062.124434:0:6708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574062.124435:0:6708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574062.124436:0:6708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574062.124437:0:6708:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574062.124438:0:6708:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574062.124439:0:6708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574062.124440:0:6708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574062.124471:0:6708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788574062.124494:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563904:0@lo:253: 00000100:00100000:2.0:1788574062.124583:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.124627:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.125049:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747563904 00000100:00100000:1.0:1788574062.125058:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747563904 00000100:00100000:1.0:1788574062.125108:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574062.125119:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:6708:x1875455747563904:12345-0@lo:253: 20000000:01000000:1.0:1788574062.125176:0:5852:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788574062.125194:0:5852:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788574062.179774:0:5852:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574062.179796:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788574062.179887:0:5873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788574062.179892:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788574062.179919:0:5873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.179939:0:5873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356a2 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.179947:0:5873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.180001:0:5873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5356a2 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.180017:0:5873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5356a2 expref: 13 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.180032:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1875455747564032:0@lo:104: 00000100:00100000:1.0:1788574062.180094:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.180170:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e949c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.180249:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564032 00000100:00100000:2.0:1788574062.180258:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564032 00000100:00100000:2.0:1788574062.180315:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574062.180326:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5873:x1875455747564032:12345-0@lo:104: 00010000:00010000:2.0:1788574062.180340:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.180417:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574062.180423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:5873:x1875455747564032:12345-0@lo:104: Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.180430:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574062.180469:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1875455747564032:0@lo:104: 00010000:00010000:2.0:1788574062.180490:0:5873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180615:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574062.180623:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180631:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574062.180636:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180645:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574062.180652:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574062.180658:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574062.180701:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180710:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574062.180728:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180735:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780031400/0x10531a153b5356a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5356a9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180765:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574062.180767:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574062.180769:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574062.180784:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747564160:0@lo:103: 00000100:00100000:3.0:1788574062.180816:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.180864:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564160 00000100:00100000:3.0:1788574062.180868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564160 00010000:00010000:3.0:1788574062.180884:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5356a2 expref: 14 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574062.180904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574062.180911:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79260ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+14:3312:x1875455747564160:12345-0@lo:103: 00010000:00010000:3.0:1788574062.180924:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574062.180928:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5356a2 expref: 14 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180937:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5356a2 expref: 14 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180950:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159000/0x10531a153b5356a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5356a2 expref: 14 pid: 5851 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180962:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180969:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788574062.180980:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001089350s 00010000:00010000:3.0:1788574062.180992:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.180999:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181006:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181013:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181017:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574062.181022:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181028:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181043:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181052:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574062.181080:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79260ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+13:3312:x1875455747564160:12345-0@lo:103: Request processed in 170us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.181087:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574062.181155:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747564160:0@lo:103: 00010000:00010000:3.0:1788574062.181174:0:5873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181182:0:5873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.181192:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21c00/0x10531a153b53574a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574062.195858:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:6708:x1875455747563904:12345-0@lo:253: Request processed in 70731us (71265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.195874:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788574062.195964:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:6708:1875455747563904:0@lo:253: 10000000:01000000:0.0:1788574062.195982:0:6708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788574062.195985:0:6708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574062.195986:0:6708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574062.195988:0:6708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574062.195989:0:6708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574062.195990:0:6708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574062.195991:0:6708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574062.195992:0:6708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574062.195993:0:6708:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574062.195994:0:6708:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574062.195996:0:6708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574062.195997:0:6708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788574062.196012:0:6708:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788574062.206831:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574062.207130:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788574062.207554:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574062.207904:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788574062.208108:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574062.208342:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788574062.210915:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788574062.539836:0:6708:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788574062.539843:0:6708:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788574062.539872:0:6708:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574062.539925:0:6708:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574062.539940:0:6708:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788574062.539966:0:6708:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788574062.912673:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574063.947491:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574064.960705:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574065.984579:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574067.014982:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574067.333733:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747564288:0@lo:400: 00000100:00100000:1.0:1788574067.333822:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788574067.340321:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788574067.340330:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a790a3d000 from 21 10000000:01000000:0.0:1788574067.340337:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574067.340401:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.340414:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.340425:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574067.340461:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747564672:0@lo:101: 00000100:00100000:0.0:1788574067.340543:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.340738:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564288 00000100:00100000:2.0:1788574067.340751:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564288 00000100:00100000:2.0:1788574067.340793:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564672 00000100:00100000:2.0:1788574067.340796:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564672 00000100:00100000:2.0:1788574067.340809:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574067.340817:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:3313:x1875455747564288:12345-0@lo:400: 00000100:00100000:2.0:1788574067.340865:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:3313:x1875455747564288:12345-0@lo:400: Request processed in 48us (7043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574067.340871:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574067.340895:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574067.340901:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747564672:12345-0@lo:101: 00010000:00010000:2.0:1788574067.340908:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574067.340919:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535751 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574067.340938:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535751 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574067.340948:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535751 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574067.340957:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159c00, rc 0) 00000100:00100000:2.0:1788574067.340976:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747564672:12345-0@lo:101: Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574067.340982:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574067.342736:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747564288:0@lo:400: 00000100:00100000:1.0:1788574067.342788:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747564416:0@lo:400: 00000100:00100000:1.0:1788574067.342849:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.342889:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574067.342896:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747564544:0@lo:400: 00000100:00100000:1.0:1788574067.342917:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.342972:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564416 00000100:00100000:1.0:1788574067.342980:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564416 00000100:00100000:1.0:1788574067.343022:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564544 00000100:00100000:1.0:1788574067.343024:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564544 00000100:00100000:1.0:1788574067.343066:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574067.343074:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747564416:12345-0@lo:400: 00000100:00100000:1.0:1788574067.343123:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747564416:12345-0@lo:400: Request processed in 49us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.343130:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574067.343144:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574067.343150:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747564544:12345-0@lo:400: 00000100:00100000:1.0:1788574067.343176:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747564544:12345-0@lo:400: Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.343182:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788574067.343215:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bd10ed80 x1875455747564544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574067.343226:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747564544:0@lo:400: 00010000:00080000:1.0:1788574067.343237:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bd10ea00 x1875455747564416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574067.343244:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747564416:0@lo:400: 00000100:00080000:3.0:1788574067.343392:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574067.343934:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792212f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.343954:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747564672:0@lo:101: 00010000:00010000:0.0:1788574067.343976:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.343989:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574067.344062:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747564800:0@lo:501: 00000100:00100000:0.0:1788574067.344098:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.344128:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792212f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574067.344292:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564800 00000100:00100000:1.0:1788574067.344299:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564800 00000100:00100000:1.0:1788574067.344343:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574067.344351:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747564800:12345-0@lo:501: 00000100:00100000:1.0:1788574067.344965:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747564800:12345-0@lo:501: Request processed in 611us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.344984:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574067.347298:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747564800:0@lo:501: 00000100:00100000:0.0:1788574067.347382:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747564928:0@lo:503: 00000100:00100000:0.0:1788574067.347456:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.347503:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792212f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574067.347707:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747564928 00000100:00100000:1.0:1788574067.347715:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747564928 00000100:00100000:1.0:1788574067.347774:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574067.347783:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747564928:12345-0@lo:503: 00000100:00100000:1.0:1788574067.348125:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747564928:12345-0@lo:503: Request processed in 342us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.348132:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574067.348180:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747564928:0@lo:503: 00000100:00100000:1.0:1788574067.348402:0:6981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6981:1875455747565056:0@lo:502: 00000100:00100000:1.0:1788574067.348440:0:6981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.348465:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565056 00000100:00100000:1.0:1788574067.348469:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565056 00000100:00100000:1.0:1788574067.348491:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574067.348498:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:6981:x1875455747565056:12345-0@lo:502: 00000100:00100000:1.0:1788574067.348804:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:6981:x1875455747565056:12345-0@lo:502: Request processed in 305us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.348811:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574067.348850:0:6981:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574067.348862:0:6981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6981:1875455747565056:0@lo:502: 00000100:00100000:1.0:1788574067.348903:0:6981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6981:1875455747565184:0@lo:502: 00000100:00100000:1.0:1788574067.348935:0:6981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.348953:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565184 00000100:00100000:1.0:1788574067.348956:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565184 00000100:00100000:1.0:1788574067.348976:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574067.348988:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:6981:x1875455747565184:12345-0@lo:502: 00000100:00100000:1.0:1788574067.349112:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:6981:x1875455747565184:12345-0@lo:502: Request processed in 124us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.349118:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574067.349144:0:6981:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574067.349154:0:6981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6981:1875455747565184:0@lo:502: 00000040:00080000:1.0:1788574067.349172:0:6981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788574067.349217:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788574067.349237:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574067.349248:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349258:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574067.349267:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788574067.349270:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a790a3d000 from 4 10000000:01000000:1.0:1788574067.349272:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574067.349309:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349318:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349334:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574067.349348:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565312:0@lo:101: 00000100:00100000:1.0:1788574067.349389:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.349412:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574067.349422:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565312 00000100:00100000:1.0:1788574067.349426:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565312 00000100:00100000:1.0:1788574067.349446:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574067.349452:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747565312:12345-0@lo:101: 00010000:00010000:1.0:1788574067.349459:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574067.349469:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53575f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349490:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53575f expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349500:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53575f expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349521:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21600, rc 0) 00000100:00100000:1.0:1788574067.349548:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747565312:12345-0@lo:101: Request processed in 96us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.349554:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574067.349797:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565312:0@lo:101: 00010000:00010000:1.0:1788574067.349811:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574067.349820:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574067.349863:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565440:0@lo:256: 00000100:00100000:1.0:1788574067.349893:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.349924:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.350392:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565440 00000100:00100000:0.0:1788574067.350398:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565440 00000100:00100000:0.0:1788574067.350429:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788574067.350438:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747565440:12345-0@lo:256: 20000000:01000000:0.0:1788574067.350453:0:5852:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574067.350469:0:5852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574067.350472:0:5852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788574067.350567:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747565440:12345-0@lo:256: Request processed in 131us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.350712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574067.350815:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565440:0@lo:256: 10000000:01000000:2.0:1788574067.350860:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574067.350867:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574067.350885:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574067.350893:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788574067.350895:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788574067.350898:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788574067.350919:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574067.350927:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574067.350935:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574067.350948:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565568:0@lo:101: 00000100:00100000:2.0:1788574067.350978:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.351008:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a08f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.351071:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565568 00000100:00100000:0.0:1788574067.351076:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565568 00000100:00100000:0.0:1788574067.351106:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574067.351114:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747565568:12345-0@lo:101: 00010000:00010000:0.0:1788574067.351122:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574067.351133:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53576d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.351151:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53576d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.351160:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53576d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.351168:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780031400, rc 0) 00000100:00100000:0.0:1788574067.351199:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747565568:12345-0@lo:101: Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.351205:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574067.351231:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565568:0@lo:101: 00010000:00010000:0.0:1788574067.351242:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574067.351251:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574067.351299:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565696:0@lo:501: 00000100:00100000:0.0:1788574067.351322:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.351340:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792212e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.351350:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565696 00000100:00100000:0.0:1788574067.351353:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565696 00000100:00100000:0.0:1788574067.351385:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574067.351392:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747565696:12345-0@lo:501: 00000100:00100000:0.0:1788574067.351754:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747565696:12345-0@lo:501: Request processed in 361us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.351763:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574067.351809:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565696:0@lo:501: 00000100:00100000:0.0:1788574067.351834:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565824:0@lo:503: 00000100:00100000:0.0:1788574067.351870:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.351883:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.351894:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565824 00000100:00100000:0.0:1788574067.351897:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565824 00000100:00100000:0.0:1788574067.351912:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574067.351917:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747565824:12345-0@lo:503: 00000100:00100000:0.0:1788574067.352188:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747565824:12345-0@lo:503: Request processed in 270us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.352194:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574067.352227:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747565824:0@lo:503: 00000100:00100000:1.0:1788574067.353167:0:6982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6982:1875455747565952:0@lo:502: 00000100:00100000:1.0:1788574067.353218:0:6982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.353256:0:6982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.353451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747565952 00000100:00100000:0.0:1788574067.353456:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747565952 00000100:00100000:0.0:1788574067.353495:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574067.353504:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:6982:x1875455747565952:12345-0@lo:502: 00000100:00100000:0.0:1788574067.353978:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:6982:x1875455747565952:12345-0@lo:502: Request processed in 473us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.353995:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574067.354093:0:6982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6982:1875455747565952:0@lo:502: 00000020:01000000:1.0:1788574067.354122:0:6982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574067.354130:0:6982:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788574067.354137:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574067.354140:0:6982:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788574067.354145:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574067.354149:0:6982:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:1.0:1788574067.354174:0:6982:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788574067.354177:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574067.354191:0:6982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a7924b8000) 00000020:00000080:1.0:1788574067.354213:0:6982:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788574067.354218:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574067.354297:0:6982:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788574067.354303:0:6982:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788574067.354311:0:6982:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b535782 00010000:00080000:1.0:1788574067.354354:0:6982:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7bb2d6800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:1.0:1788574067.354729:0:6982:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788574067.426926:0:6982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788574067.426949:0:6982:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788574067.432745:0:6982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574067.432899:0:6982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574067.432940:0:6982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788574067.432986:0:6982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788574067.434849:0:6988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574067.434928:0:6988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788574067.438721:0:6982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788574067.438738:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788574067.438777:0:6982:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788574067.438799:0:6982:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b535789 00000100:00080000:3.0:1788574067.438811:0:6982:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574067.438817:0:6982:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7bb2d6800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574067.438853:0:6982:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bb28ce00 x1875455747566080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574067.438914:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747566080:0@lo:8: 00000100:00100000:1.0:1788574067.438999:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.439090:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566080 00000100:00100000:0.0:1788574067.439109:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566080 00000100:00100000:0.0:1788574067.439148:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574067.439157:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747566080:12345-0@lo:8: 00010000:00080000:0.0:1788574067.439187:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1788574067.439215:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b535790 00002000:00100000:0.0:1788574067.439245:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a7c1c1a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788574067.439249:0:6711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788574067.439254:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788574067.439738:0:6711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788574067.439976:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788574067.440004:0:6711:0:(import.c:65:import_set_state_nolock()) ffff90a7c1c1f000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788574067.440094:0:6982:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788574067.440200:0:6982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574067.440206:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574067.440209:0:6982:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788574067.440212:0:6982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574067.440216:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574067.440218:0:6982:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574067.440221:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574067.440223:0:6982:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788574067.440255:0:6982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6982:1875455747566208:0@lo:502: 00000100:00100000:3.0:1788574067.440308:0:6982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574067.440341:0:6982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbc7e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574067.448104:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875455747566080:12345-0@lo:8: Request processed in 8931us (9088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.448120:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788574067.453300:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28ce00 x1875455747566080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574067.453326:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574067.453338:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788574067.453348:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574067.453356:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788574067.453359:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2d6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574067.453387:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574067.453394:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747566080:0@lo:8: 00000100:00100000:1.0:1788574067.453457:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566208 00000004:00080000:0.0:1788574067.453459:0:6988:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788574067.453465:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566208 00000004:00080000:0.0:1788574067.453764:0:6988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193628395209ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788574067.453902:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574067.453913:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+15:6982:x1875455747566208:12345-0@lo:502: 00000100:00100000:1.0:1788574067.454289:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+15:6982:x1875455747566208:12345-0@lo:502: Request processed in 377us (13980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574067.454298:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574067.459338:0:6982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:6982:1875455747566208:0@lo:502: 00000020:01000000:3.0:1788574067.459403:0:6982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574067.459417:0:6982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574067.459420:0:6982:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788574067.459425:0:6982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788574067.459600:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788574067.459627:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788574067.459639:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.459653:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574067.459664:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788574067.459666:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a792418000 from 1 10000000:01000000:3.0:1788574067.459670:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788574067.459705:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.459713:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.459723:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574067.459742:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747566336:0@lo:101: 00000100:00100000:3.0:1788574067.459803:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574067.459850:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbc7e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574067.460769:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566336 00000100:00100000:3.0:1788574067.460781:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566336 00000100:00100000:3.0:1788574067.460834:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574067.460845:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747566336:12345-0@lo:101: 00010000:00010000:3.0:1788574067.460859:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574067.460882:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535797 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.460907:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535797 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.460919:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535797 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.460928:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165ba00, rc 0) 00000100:00100000:3.0:1788574067.460985:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747566336:12345-0@lo:101: Request processed in 141us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574067.460993:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574067.461060:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747566336:0@lo:101: 00010000:00010000:3.0:1788574067.461077:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.461087:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574067.461139:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747566464:0@lo:501: 00000100:00100000:3.0:1788574067.461167:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574067.461196:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbc7e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574067.461213:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566464 00000100:00100000:3.0:1788574067.461216:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566464 00000100:00100000:3.0:1788574067.461238:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574067.461244:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747566464:12345-0@lo:501: 00000100:00100000:3.0:1788574067.461443:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747566464:12345-0@lo:501: Request processed in 198us (274us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574067.461457:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574067.461489:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747566464:0@lo:501: 10000000:01000000:3.0:1788574067.461689:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788574067.461697:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574067.461705:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574067.521313:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788574067.583434:0:6989:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788574067.583474:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747566720:0@lo:7: 00000100:00100000:2.0:1788574067.583550:0:6989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.583602:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574067.583641:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747566592:0@lo:13: 00000100:00100000:2.0:1788574067.583669:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.583717:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566720 00000100:00100000:2.0:1788574067.583725:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566720 00000100:00100000:2.0:1788574067.583783:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574067.583792:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6989:x1875455747566720:12345-0@lo:7: 00000100:00080000:1.0:1788574067.587267:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574067.587304:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566592 00000100:00100000:1.0:1788574067.587314:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566592 00000100:00100000:1.0:1788574067.587423:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574067.587436:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875455747566592:12345-0@lo:13: 00002000:00000024:1.0:1788574067.587472:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788574067.587569:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875455747566592:12345-0@lo:13: Request processed in 136us (3898us total) trans 0 rc 0/0 00010000:00080000:2.0:1788574067.587595:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb289c00 x1875455747566592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.587620:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747566592:0@lo:13: 00000100:00100000:1.0:1788574067.587753:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1788574067.589930:0:6713:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788574067.589938:0:6713:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788574067.590156:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6989:x1875455747566720:12345-0@lo:7: Request processed in 6361us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574067.590167:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574067.590306:0:6989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28a680 x1875455747566720/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574083 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.590409:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747566720:0@lo:7: 00000004:00080000:2.0:1788574067.590426:0:6989:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788574067.590468:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747566848:0@lo:5: 00000100:00100000:2.0:1788574067.590502:0:6989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.590533:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574067.590631:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566848 00000100:00100000:2.0:1788574067.590638:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566848 00000100:00100000:2.0:1788574067.590684:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574067.590694:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6989:x1875455747566848:12345-0@lo:5: 00002000:00080000:2.0:1788574067.590718:0:6713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788574067.590721:0:6713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788574067.590951:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6989:x1875455747566848:12345-0@lo:5: Request processed in 259us (448us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788574067.590958:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788574067.590984:0:6989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28a680 x1875455747566848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574083 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.591142:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747566848:0@lo:5: 00000004:00080000:2.0:1788574067.591153:0:6989:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788574067.591237:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747566976:0@lo:700: 00000100:00100000:2.0:1788574067.591266:0:6989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.591284:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574067.591305:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747566976 00000100:00100000:2.0:1788574067.591309:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747566976 00000100:00100000:2.0:1788574067.591527:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574067.591535:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6989:x1875455747566976:12345-0@lo:700: 00000100:00100000:2.0:1788574067.591568:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6720:1875455747567104:0@lo:700: 00000100:00100000:2.0:1788574067.591599:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.591617:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574067.591633:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567104 00000100:00100000:2.0:1788574067.591637:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567104 00000100:00100000:2.0:1788574067.591661:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574067.591668:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6720:x1875455747567104:12345-0@lo:700: 40000000:02000000:2.0:1788574067.633756:0:5864:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788574067.645938:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6720:x1875455747567104:12345-0@lo:700: Request processed in 54262us (54330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574067.645953:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788574067.646067:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28b800 x1875455747567104/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788574083 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574067.646093:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6720:1875455747567104:0@lo:700: 40000000:02000000:3.0:1788574067.646108:0:6720:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788574067.776833:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6989:x1875455747566976:12345-0@lo:700: Request processed in 185292us (185559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574067.776862:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:3.0:1788574067.776896:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788574067.776910:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:2.0:1788574067.776965:0:6989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb289f80 x1875455747566976/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788574083 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.776982:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747566976:0@lo:700: 00000004:02000040:2.0:1788574067.848181:0:6989:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788574067.850964:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747567232:0@lo:5: 00000100:00100000:2.0:1788574067.851032:0:6989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574067.856209:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574067.860868:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567232 00000100:00100000:1.0:1788574067.860884:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567232 00000100:00100000:0.0:1788574067.861139:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574067.861150:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6989:x1875455747567232:12345-0@lo:5: 00002000:00080000:0.0:1788574067.866706:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788574067.866731:0:6712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788574067.870258:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6989:x1875455747567232:12345-0@lo:5: Request processed in 9104us (19219us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788574067.870279:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788574067.870416:0:6989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb289f80 x1875455747567232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574083 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574067.870431:0:6989:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788574067.870447:0:6989:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90a7bb289f80 x1875455747567232/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574083 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574067.870458:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6989:1875455747567232:0@lo:5: 00000004:00080000:1.0:1788574067.870470:0:6989:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788574068.041735:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574069.056757:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574069.632084:0:7086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788574070.080739:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574071.104958:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574072.131118:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574072.971523:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747567360:0@lo:400: 00000100:00100000:3.0:1788574072.971601:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.971655:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574072.971662:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747567744:0@lo:400: 00000100:00100000:3.0:1788574072.971696:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.971731:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747567488:0@lo:400: 00000100:00100000:3.0:1788574072.971798:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.971818:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574072.971823:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747567616:0@lo:400: 00000100:00100000:3.0:1788574072.971843:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.971888:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567360 00000100:00100000:3.0:1788574072.971895:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567360 00000100:00100000:3.0:1788574072.971931:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574072.971939:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:3313:x1875455747567360:12345-0@lo:400: 00000100:00100000:3.0:1788574072.971993:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:3313:x1875455747567360:12345-0@lo:400: Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.972000:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574072.972033:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567488 00000100:00100000:3.0:1788574072.972037:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567488 00000100:00100000:3.0:1788574072.972061:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567616 00000100:00100000:3.0:1788574072.972064:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567616 00000100:00100000:3.0:1788574072.972090:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574072.972096:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747567488:12345-0@lo:400: 00000100:00100000:3.0:1788574072.972129:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747567488:12345-0@lo:400: Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.972135:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574072.972146:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574072.972153:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747567616:12345-0@lo:400: 00000100:00100000:3.0:1788574072.972175:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747567616:12345-0@lo:400: Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.972181:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574072.972214:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747567360:0@lo:400: 00000100:00080000:3.0:1788574072.973026:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788574072.973063:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28fb80 x1875455747567616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574072.973077:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747567616:0@lo:400: 00010000:00080000:3.0:1788574072.973089:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28c700 x1875455747567488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574072.973098:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747567488:0@lo:400: 00000100:00100000:2.0:1788574072.973731:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567744 00000100:00100000:2.0:1788574072.973741:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567744 00000100:00100000:2.0:1788574072.973815:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574072.973824:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875455747567744:12345-0@lo:400: 00000100:00100000:2.0:1788574072.973905:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875455747567744:12345-0@lo:400: Request processed in 82us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.973911:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788574072.974003:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574072.982667:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747567872:0@lo:13: 00000100:00100000:2.0:1788574072.982756:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788574072.982833:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28e300 x1875455747567744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574072.982848:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747567744:0@lo:400: 00000100:00100000:1.0:1788574072.984394:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747567872 00000100:00100000:1.0:1788574072.984408:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747567872 00000100:00100000:1.0:1788574072.984462:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574072.984471:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875455747567872:12345-0@lo:13: 00002000:00000024:1.0:1788574072.984525:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574072.984600:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875455747567872:12345-0@lo:13: Request processed in 130us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574072.984607:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574072.990113:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28a300 x1875455747567872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574072.990142:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747567872:0@lo:13: 00010000:00010000:1.0:1788574073.155623:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788574073.179829:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788574074.177915:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574075.208405:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574076.224667:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574077.249422:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574078.080615:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747568000:0@lo:13: 00000100:00100000:3.0:1788574078.080699:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.080947:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568000 00000100:00100000:2.0:1788574078.080957:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568000 00000100:00100000:2.0:1788574078.081019:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574078.081028:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747568000:12345-0@lo:13: 00002000:00000024:2.0:1788574078.081065:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574078.081120:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747568000:12345-0@lo:13: Request processed in 93us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.081127:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574078.081262:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747568256:0@lo:400: 00000100:00100000:1.0:1788574078.081295:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574078.081315:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574078.081320:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747568384:0@lo:400: 00000100:00100000:1.0:1788574078.081340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574078.081425:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574078.081438:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568256 00000100:00100000:3.0:1788574078.081442:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568256 00000100:00100000:3.0:1788574078.081480:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568384 00000100:00100000:3.0:1788574078.081483:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568384 00000100:00100000:3.0:1788574078.081503:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574078.081509:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747568256:12345-0@lo:400: 00000100:00100000:3.0:1788574078.081550:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747568256:12345-0@lo:400: Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.081556:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574078.081570:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574078.081575:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747568384:12345-0@lo:400: 00000100:00100000:3.0:1788574078.081601:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747568384:12345-0@lo:400: Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.081607:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574078.081628:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747568128:0@lo:400: 00000100:00100000:3.0:1788574078.081661:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.081708:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568128 00000100:00100000:3.0:1788574078.081712:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568128 00000100:00100000:3.0:1788574078.081814:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574078.081823:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:3315:x1875455747568128:12345-0@lo:400: 00000100:00100000:3.0:1788574078.081861:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:3315:x1875455747568128:12345-0@lo:400: Request processed in 39us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.081878:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788574078.081908:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574078.081933:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747568128:0@lo:400: 00010000:00080000:3.0:1788574078.081965:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bd10df80 x1875455747568384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574078.081977:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747568384:0@lo:400: 00010000:00080000:3.0:1788574078.081987:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bd10e300 x1875455747568256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574078.081995:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747568256:0@lo:400: 00010000:00080000:3.0:1788574078.082019:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28a300 x1875455747568000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574078.082028:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788574078.082047:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747568000:0@lo:13: 00010000:00010000:1.0:1788574078.273896:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574079.307441:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574080.320514:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574081.344849:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574082.226884:0:7658:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574082.226888:0:7658:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788574082.227183:0:7658:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a6812f6000 00000020:01000004:3.0:1788574082.227199:0:7658:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788574082.227210:0:7658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788574082.227232:0:7658:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a791dc99c0) 00000020:00000080:3.0:1788574082.227249:0:7658:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788574082.257458:0:7658:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788574082.257698:0:7658:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788574082.288495:0:7658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788574082.296016:0:7658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788574082.296048:0:7658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788574082.296106:0:7658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788574082.296133:0:7658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788574082.296707:0:7658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788574082.296718:0:7658:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788574082.296727:0:7658:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x10531a153b5357ac 00000020:01000004:3.0:1788574082.296735:0:7658:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788574082.296753:0:7658:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788574082.296756:0:7658:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788574082.296761:0:7658:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788574082.296779:0:7658:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788574082.296783:0:7658:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788574082.319818:0:7658:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788574082.320128:0:7658:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.157@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788574082.320132:0:7658:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788574082.320134:0:7658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574082.320135:0:7658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574082.320136:0:7658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574082.320138:0:7658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574082.320139:0:7658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574082.320141:0:7658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574082.320142:0:7658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574082.320144:0:7658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574082.320145:0:7658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574082.320146:0:7658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574082.320150:0:7658:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788574082.320152:0:7658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574082.320153:0:7658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574082.320154:0:7658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574082.320155:0:7658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574082.320156:0:7658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574082.320157:0:7658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574082.320162:0:7658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574082.320163:0:7658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574082.320164:0:7658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574082.320165:0:7658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574082.320165:0:7658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574082.320203:0:7658:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788574082.320221:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747568512:0@lo:253: 00000100:00100000:3.0:1788574082.320305:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.320620:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792296540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574082.322662:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568512 00000100:00100000:0.0:1788574082.322676:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568512 00000100:00100000:0.0:1788574082.322758:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574082.322769:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+16:7658:x1875455747568512:12345-0@lo:253: 20000000:01000000:0.0:1788574082.322840:0:5851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788574082.322954:0:5851:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788574082.322961:0:5851:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788574082.322964:0:5851:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788574082.326316:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574082.326680:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788574082.326696:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788574082.326744:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788574082.326752:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788574082.326782:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788574082.327146:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788574082.328066:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788574082.328088:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:0.0:1788574082.328090:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:0.0:1788574082.328118:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788574082.328125:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788574082.328168:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788574082.328177:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:0.0:1788574082.328221:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788574082.328231:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788574082.328512:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788574082.328571:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788574082.329714:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788574082.329737:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:0.0:1788574082.329739:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:0.0:1788574082.329771:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788574082.329778:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788574082.329943:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788574082.329953:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:0.0:1788574082.329981:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788574082.329988:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788574082.330048:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788574082.330090:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788574082.330107:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788574082.330109:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788574082.330113:0:5851:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788574082.330125:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788574082.330128:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788574082.330161:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788574082.330163:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788574082.331041:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788574082.331646:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788574082.331691:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788574082.331757:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788574082.331771:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788574082.331773:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788574082.337691:0:7661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788574082.337784:0:7661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788574082.338067:0:7661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788574082.338497:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788574082.338540:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788574082.338602:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788574082.338623:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788574082.338626:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788574082.340052:0:7662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788574082.340148:0:7662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788574082.340201:0:7662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788574082.340544:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788574082.340587:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788574082.340640:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788574082.340656:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788574082.340659:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788574082.341454:0:7663:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788574082.341512:0:7663:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788574082.341567:0:7663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788574082.341959:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788574082.342000:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788574082.342037:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788574082.342054:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788574082.342057:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788574082.342072:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788574082.342091:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342109:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356fd expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342117:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535727 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342124:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535751 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342131:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53576d expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342137:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535797 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342144:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342183:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535797 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342198:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535797 expref: 16 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.342213:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747568640:0@lo:104: 00000100:00100000:0.0:1788574082.342285:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574082.342357:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53576d expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342406:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53576d expref: 16 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.342415:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747568768:0@lo:104: 00010000:00010000:0.0:1788574082.342441:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535751 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342448:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535751 expref: 16 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.342455:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747568896:0@lo:104: 00010000:00010000:0.0:1788574082.342471:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535727 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342478:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535727 expref: 16 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.342486:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747569024:0@lo:104: 00010000:00010000:0.0:1788574082.342503:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5356fd expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.342509:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5356fd expref: 16 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.342517:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747569152:0@lo:104: 00000100:00100000:0.0:1788574082.342530:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7674c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.342809:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788574082.342828:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.342843:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.342850:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.342856:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.342865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568640 00000100:00100000:3.0:1788574082.342872:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568640 00000100:00100000:3.0:1788574082.342902:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568768 00000100:00100000:3.0:1788574082.342905:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568768 00000100:00100000:3.0:1788574082.342915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747568896 00000100:00100000:3.0:1788574082.342918:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747568896 00000100:00100000:3.0:1788574082.342925:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569024 00000100:00100000:3.0:1788574082.342927:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569024 00000100:00100000:3.0:1788574082.342933:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569152 00000100:00100000:3.0:1788574082.342941:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569152 00000100:00100000:3.0:1788574082.342954:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574082.342962:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+7:5851:x1875455747568640:12345-0@lo:104: 00010000:00010000:3.0:1788574082.342974:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343068:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574082.343074:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+7:5851:x1875455747568640:12345-0@lo:104: Request processed in 113us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.343081:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574082.343119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574082.343124:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+6:5851:x1875455747568768:12345-0@lo:104: 00010000:00010000:3.0:1788574082.343130:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343156:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574082.343160:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+6:5851:x1875455747568768:12345-0@lo:104: Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.343165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574082.343174:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574082.343178:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+5:5851:x1875455747568896:12345-0@lo:104: 00010000:00010000:3.0:1788574082.343184:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343208:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788574082.343213:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+5:5851:x1875455747568896:12345-0@lo:104: Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.343218:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574082.343251:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574082.343258:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:5851:x1875455747569024:12345-0@lo:104: 00010000:00010000:3.0:1788574082.343266:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343292:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788574082.343296:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:5851:x1875455747569024:12345-0@lo:104: Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.343302:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574082.343312:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574082.343318:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:5851:x1875455747569152:12345-0@lo:104: 00010000:00010000:3.0:1788574082.343337:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343358:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788574082.343362:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:5851:x1875455747569152:12345-0@lo:104: Request processed in 45us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.343386:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788574082.343400:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788574082.343405:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343412:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.343415:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343424:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.343441:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.343446:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.343472:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343478:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.343493:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343500:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b535797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53579e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343512:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788574082.343516:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343520:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159a00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.343523:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343529:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.343535:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.343540:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.343559:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343564:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.343569:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343575:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b53576d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535774 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343590:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788574082.343594:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343599:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.343602:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343608:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.343614:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.343620:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.343630:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343636:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.343650:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343666:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780030400/0x10531a153b535751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343676:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574082.343679:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343684:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.343687:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343694:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.343701:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.343706:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.343717:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343722:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.343726:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343732:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21200/0x10531a153b535727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53572e expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343740:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574082.343746:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343751:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031a00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.343754:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343760:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.343765:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.343770:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.343780:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343784:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.343788:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343804:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780031a00/0x10531a153b5356fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535704 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.343817:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.343818:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.343820:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.343827:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.343832:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574082.343852:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747569280:0@lo:103: 00000100:00100000:3.0:1788574082.343886:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.343924:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747569792:0@lo:103: 00000100:00100000:3.0:1788574082.343944:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.343963:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574082.343968:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747569408:0@lo:103: 00000100:00100000:3.0:1788574082.343984:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.344008:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747569536:0@lo:103: 00000100:00100000:3.0:1788574082.344039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.344053:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574082.344057:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747569664:0@lo:103: 00000100:00100000:3.0:1788574082.344074:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.344097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569280 00000100:00100000:3.0:1788574082.344102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569280 00010000:00010000:3.0:1788574082.344121:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535797 expref: 17 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.344136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569792 00000100:00100000:3.0:1788574082.344138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569792 00010000:00010000:3.0:1788574082.344146:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5356fd expref: 18 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.344154:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569408 00000100:00100000:3.0:1788574082.344156:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569408 00010000:00010000:3.0:1788574082.344163:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53576d expref: 19 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.344173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569536 00000100:00100000:3.0:1788574082.344175:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569536 00010000:00010000:3.0:1788574082.344184:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535751 expref: 20 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.344194:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569664 00000100:00100000:3.0:1788574082.344203:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569664 00010000:00010000:3.0:1788574082.344214:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535727 expref: 21 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.344227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574082.344234:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+21:3314:x1875455747569280:12345-0@lo:103: 00010000:00010000:3.0:1788574082.344244:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.344249:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535797 expref: 21 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344260:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535797 expref: 21 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344276:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.344307:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+21:3314:x1875455747569280:12345-0@lo:103: Request processed in 74us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.344313:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574082.344326:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574082.344331:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+20:3314:x1875455747569792:12345-0@lo:103: 00010000:00010000:3.0:1788574082.344339:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.344343:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5356fd expref: 20 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344350:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5356fd expref: 20 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344359:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.344405:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+20:3314:x1875455747569792:12345-0@lo:103: Request processed in 73us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.344411:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574082.344431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574082.344436:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747569408:12345-0@lo:103: 00010000:00010000:3.0:1788574082.344443:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.344446:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53576d expref: 19 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344454:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53576d expref: 19 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344462:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.344479:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747569408:12345-0@lo:103: Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.344484:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574082.344494:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574082.344498:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+18:3312:x1875455747569536:12345-0@lo:103: 00010000:00010000:3.0:1788574082.344504:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.344508:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535751 expref: 18 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344516:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535751 expref: 18 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344524:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.344547:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+18:3312:x1875455747569536:12345-0@lo:103: Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.344553:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574082.344564:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574082.344570:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+17:3312:x1875455747569664:12345-0@lo:103: 00010000:00010000:3.0:1788574082.344577:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.344586:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535727 expref: 17 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344593:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535727 expref: 17 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344604:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344612:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344625:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344632:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344638:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344644:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344649:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4dc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574082.344653:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344661:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344668:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.344688:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.344710:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+17:3312:x1875455747569664:12345-0@lo:103: Request processed in 141us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.344716:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574082.344758:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747569664:0@lo:103: 00000100:00100000:3.0:1788574082.344766:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747569536:0@lo:103: 00000100:00100000:3.0:1788574082.344804:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747569408:0@lo:103: 00000100:00100000:3.0:1788574082.344814:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747569280:0@lo:103: 00000100:00100000:3.0:1788574082.344820:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747569792:0@lo:103: 00010000:00010000:2.0:1788574082.348697:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165ba00/0x10531a153b53579e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535797 expref: 16 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574082.348719:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747568640:0@lo:104: 00010000:00010000:2.0:1788574082.348733:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a780031400/0x10531a153b535774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53576d expref: 15 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574082.348742:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747568768:0@lo:104: 00010000:00010000:2.0:1788574082.348752:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159c00/0x10531a153b535758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535751 expref: 14 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574082.348765:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747568896:0@lo:104: 00010000:00010000:2.0:1788574082.348775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a400/0x10531a153b53572e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535727 expref: 13 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574082.348783:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747569024:0@lo:104: 00010000:00010000:2.0:1788574082.349025:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a800/0x10531a153b535704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5356fd expref: 12 pid: 5851 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574082.349034:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1875455747569152:0@lo:104: 00010000:00010000:2.0:1788574082.349085:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.349095:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.349101:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.349106:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b5357b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574082.349120:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788574082.376451:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574082.396906:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+11:7658:x1875455747568512:12345-0@lo:253: Request processed in 74133us (76595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.396921:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574082.397003:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747568512:0@lo:253: 10000000:01000000:3.0:1788574082.397138:0:7658:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788574082.397143:0:7658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574082.397145:0:7658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574082.397146:0:7658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574082.397148:0:7658:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788574082.397150:0:7658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574082.397151:0:7658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574082.397152:0:7658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574082.397154:0:7658:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788574082.397156:0:7658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574082.397157:0:7658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788574082.397182:0:7658:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a6812f6000 from lustre-OST0001 10000000:01000000:3.0:1788574082.397206:0:7658:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788574082.397210:0:7658:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788574082.397217:0:7658:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a792418000 local copy 10000000:01000000:3.0:1788574082.397221:0:7658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788574082.397265:0:7658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.397276:0:7658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.397285:0:7658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.397302:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747569920:0@lo:101: 00000100:00100000:3.0:1788574082.397564:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.397629:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574082.397682:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747569920 00000100:00100000:0.0:1788574082.397688:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747569920 00000100:00100000:0.0:1788574082.397769:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788574082.397778:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+11:7658:x1875455747569920:12345-0@lo:101: 00010000:00010000:0.0:1788574082.397799:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574082.397821:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5357c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5357ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.397844:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5357c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5357ba expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.397855:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5357c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357ba expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.397865:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c600, rc 0) 00000100:00100000:0.0:1788574082.397907:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747569920:12345-0@lo:101: Request processed in 130us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574082.397913:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788574082.397970:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747569920:0@lo:101: 00010000:00010000:1.0:1788574082.397986:0:7658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.397995:0:7658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574082.398094:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570048:0@lo:501: 00000100:00100000:1.0:1788574082.398120:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574082.400160:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784d06780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.400247:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570048 00000100:00100000:3.0:1788574082.400255:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570048 00000100:00100000:3.0:1788574082.400299:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574082.400308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570048:12345-0@lo:501: 00000100:00100000:3.0:1788574082.400590:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570048:12345-0@lo:501: Request processed in 282us (2467us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574082.400598:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788574082.400745:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570048:0@lo:501: 10000000:01000000:1.0:1788574082.400765:0:7658:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788574082.400956:0:7658:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788574082.400964:0:7658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.400974:0:7658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.400982:0:7658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.401017:0:7658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788574082.401038:0:7658:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a6812f6000 10000000:01000000:1.0:1788574082.401043:0:7658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574082.401049:0:7658:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788574082.401051:0:7658:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574082.401055:0:7658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788574082.401058:0:7658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788574082.401083:0:7658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.401091:0:7658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.401100:0:7658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574082.401118:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570176:0@lo:101: 00000100:00100000:1.0:1788574082.401150:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574082.401171:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784d06e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574082.401230:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570176 00000100:00100000:0.0:1788574082.401236:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570176 00000100:00100000:0.0:1788574082.401264:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574082.401271:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570176:12345-0@lo:101: 00010000:00010000:0.0:1788574082.401280:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574082.401292:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5357c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.401312:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5357c8 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.401409:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357c8 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.401429:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4cc00, rc 0) 00000100:00100000:0.0:1788574082.401458:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747570176:12345-0@lo:101: Request processed in 186us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574082.401464:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788574082.401544:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570176:0@lo:101: 00010000:00010000:1.0:1788574082.401557:0:7658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.401566:0:7658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574082.401627:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570304:0@lo:501: 00000100:00100000:1.0:1788574082.401659:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574082.401685:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784d06e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788574082.401739:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574082.401746:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.401753:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.401758:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.401765:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.401787:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.401892:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.401913:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.401919:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.401946:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.401953:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x10531a153b5357c1 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.401966:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.401968:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.401970:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574082.401978:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574082.401988:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747570432:0@lo:103: 00000100:00100000:3.0:1788574082.402016:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.402043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570432 00000100:00100000:3.0:1788574082.402047:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570432 00000100:00100000:3.0:1788574082.402079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574082.402087:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+13:3314:x1875455747570432:12345-0@lo:103: 00010000:00010000:3.0:1788574082.402097:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.402107:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5357c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b5357ba expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.402116:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.402150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+12:3314:x1875455747570432:12345-0@lo:103: Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.402156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574082.402186:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747570432:0@lo:103: 00000100:00100000:3.0:1788574082.402204:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570304 00000100:00100000:3.0:1788574082.402207:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570304 00000100:00100000:3.0:1788574082.402223:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574082.402228:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570304:12345-0@lo:501: 00000100:00100000:3.0:1788574082.404209:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570304:12345-0@lo:501: Request processed in 1970us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.404221:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574082.404540:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570304:0@lo:501: 00000100:00100000:1.0:1788574082.404587:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570560:0@lo:503: 00000100:00100000:1.0:1788574082.404630:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574082.404665:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784d06e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.404714:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570560 00000100:00100000:3.0:1788574082.404721:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570560 00000100:00100000:3.0:1788574082.404759:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574082.404767:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570560:12345-0@lo:503: 00000100:00100000:3.0:1788574082.405103:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570560:12345-0@lo:503: Request processed in 336us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.405109:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574082.405179:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570560:0@lo:503: 00000040:00080000:1.0:1788574082.405512:0:7658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574082.405574:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570688:0@lo:502: 00000100:00100000:1.0:1788574082.405614:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574082.405643:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784d06e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574082.405767:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570688 00000100:00100000:2.0:1788574082.405772:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570688 00000100:00100000:2.0:1788574082.405829:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788574082.405837:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570688:12345-0@lo:502: 00000100:00100000:2.0:1788574082.405979:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570688:12345-0@lo:502: Request processed in 142us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574082.405985:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574082.406177:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570688:0@lo:502: 00000040:00080000:3.0:1788574082.406449:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788574082.406496:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788574082.406530:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788574082.406576:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788574082.406610:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788574082.406643:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788574082.406671:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570816:0@lo:502: 00000100:00100000:3.0:1788574082.406709:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.406741:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.406900:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570816 00000100:00100000:1.0:1788574082.406906:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570816 00000100:00100000:1.0:1788574082.406943:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574082.406952:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570816:12345-0@lo:502: 00000100:00100000:1.0:1788574082.407098:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570816:12345-0@lo:502: Request processed in 147us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.407105:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574082.407304:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570816:0@lo:502: 00000040:00080000:3.0:1788574082.407436:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788574082.407448:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788574082.408163:0:7666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788574082.408171:0:7666:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788574082.408177:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574082.408178:0:7666:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788574082.408183:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574082.408197:0:7666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a791dcb380) 00000020:00000080:3.0:1788574082.408220:0:7666:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788574082.408227:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574082.408287:0:7666:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6812f6000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788574082.408294:0:7666:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788574082.408301:0:7666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x10531a153b5357dd 00010000:00010000:2.0:1788574082.412314:0:7666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788574082.413246:0:7666:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788574082.417094:0:7666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788574082.417404:0:7666:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788574082.422314:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788574082.423027:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788574082.427455:0:7666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788574082.427466:0:7666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574082.427471:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574082.427474:0:7666:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788574082.427484:0:7666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574082.427487:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574082.427489:0:7666:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574082.427491:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574082.427493:0:7666:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574082.427550:0:7666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574082.427554:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574082.427555:0:7666:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788574082.427558:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788574082.427823:0:7658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788574082.427850:0:7658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788574082.427873:0:7658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.427885:0:7658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.427892:0:7658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6812f6000 from 1 10000000:01000000:3.0:1788574082.427895:0:7658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574082.427928:0:7658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.427935:0:7658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.427946:0:7658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.427977:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570944:0@lo:101: 00000100:00100000:3.0:1788574082.428047:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.428092:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574082.428301:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747570944 00000100:00100000:2.0:1788574082.428309:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747570944 00000100:00100000:2.0:1788574082.428361:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574082.428474:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+12:7658:x1875455747570944:12345-0@lo:101: 00010000:00010000:2.0:1788574082.428489:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574082.428502:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5357e4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.428523:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5357e4 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.428533:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357e4 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.428541:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159c00, rc 0) 00000100:00100000:2.0:1788574082.428621:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747570944:12345-0@lo:101: Request processed in 151us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574082.428627:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788574082.434830:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747570944:0@lo:101: 00010000:00010000:0.0:1788574082.434862:0:7658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.434875:0:7658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.435008:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571072:0@lo:501: 00000100:00100000:0.0:1788574082.435065:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574082.435158:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.437465:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571072 00000100:00100000:3.0:1788574082.437477:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571072 00000100:00100000:3.0:1788574082.437568:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574082.437578:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571072:12345-0@lo:501: 00000100:00100000:3.0:1788574082.437890:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571072:12345-0@lo:501: Request processed in 312us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.437899:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788574082.438002:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571072:0@lo:501: 00000100:00100000:0.0:1788574082.438052:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571200:0@lo:503: 00000100:00100000:0.0:1788574082.438096:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574082.444764:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.444904:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571200 00000100:00100000:1.0:1788574082.444913:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571200 00000100:00100000:1.0:1788574082.444963:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574082.444974:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571200:12345-0@lo:503: 00000100:00100000:1.0:1788574082.445362:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571200:12345-0@lo:503: Request processed in 390us (7265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.445406:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788574082.445570:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571200:0@lo:503: 00000040:00080000:0.0:1788574082.445875:0:7658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574082.445947:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571328:0@lo:502: 00000100:00100000:0.0:1788574082.445995:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574082.446026:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.446262:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571328 00000100:00100000:1.0:1788574082.446274:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571328 00000100:00100000:1.0:1788574082.446297:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788574082.446304:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571328:12345-0@lo:502: 00000100:00100000:1.0:1788574082.446489:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571328:12345-0@lo:502: Request processed in 183us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.446496:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788574082.446625:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571328:0@lo:502: 00000040:00080000:0.0:1788574082.446960:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788574082.447003:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788574082.447025:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571456:0@lo:502: 00000100:00100000:0.0:1788574082.447057:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574082.447084:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.447132:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571456 00000100:00100000:1.0:1788574082.447136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571456 00000100:00100000:1.0:1788574082.447172:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788574082.447178:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571456:12345-0@lo:502: 00000100:00100000:1.0:1788574082.447293:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571456:12345-0@lo:502: Request processed in 114us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.447300:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788574082.447468:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571456:0@lo:502: 00000040:00080000:0.0:1788574082.447541:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788574082.447551:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788574082.448243:0:7670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574082.448254:0:7670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574082.448257:0:7670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788574082.448263:0:7670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6812f6000 00000020:00000080:2.0:1788574082.448274:0:7670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574082.448298:0:7670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574082.448302:0:7670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574082.448303:0:7670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788574082.448306:0:7670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788574082.449972:0:7658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788574082.450004:0:7658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574082.450080:0:7658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.450092:0:7658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.450144:0:7658:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574082.450147:0:7658:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a6812f6000 10000000:01000000:3.0:1788574082.450150:0:7658:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a6812f6000 10000000:01000000:3.0:1788574082.450153:0:7658:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574082.450158:0:7658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6812f6000 from 1 10000000:01000000:3.0:1788574082.450160:0:7658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574082.450192:0:7658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.450200:0:7658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.450222:0:7658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.450243:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571584:0@lo:101: 00000100:00100000:3.0:1788574082.450305:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.450565:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.450633:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571584 00000100:00100000:1.0:1788574082.450640:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571584 00000100:00100000:1.0:1788574082.450686:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788574082.450695:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747571584:12345-0@lo:101: 00010000:00010000:1.0:1788574082.450707:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574082.450720:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5357f2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.450741:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5357f2 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.450751:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357f2 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.450759:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21000, rc 0) 00000100:00100000:1.0:1788574082.450899:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571584:12345-0@lo:101: Request processed in 205us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.450914:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788574082.451070:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571584:0@lo:101: 00010000:00010000:2.0:1788574082.451088:0:7658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574082.451096:0:7658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574082.451198:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571712:0@lo:501: 00000100:00100000:2.0:1788574082.451231:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574082.451293:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e38780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.451486:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571712 00000100:00100000:3.0:1788574082.451492:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571712 00000100:00100000:3.0:1788574082.451563:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788574082.451571:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571712:12345-0@lo:501: 00000100:00100000:3.0:1788574082.454534:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571712:12345-0@lo:501: Request processed in 2953us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.454548:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788574082.454767:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571712:0@lo:501: 00000100:00100000:2.0:1788574082.454830:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571840:0@lo:503: 00000100:00100000:2.0:1788574082.454908:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574082.455093:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e38780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.455128:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571840 00000100:00100000:3.0:1788574082.455135:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571840 00000100:00100000:3.0:1788574082.455177:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788574082.455185:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571840:12345-0@lo:503: 00000100:00100000:3.0:1788574082.455747:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571840:12345-0@lo:503: Request processed in 561us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.455755:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574082.455952:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571840:0@lo:503: 00000040:00080000:2.0:1788574082.456221:0:7658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574082.456633:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571968:0@lo:502: 00000100:00100000:0.0:1788574082.456682:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574082.456761:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.456804:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747571968 00000100:00100000:1.0:1788574082.456811:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747571968 00000100:00100000:1.0:1788574082.456937:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574082.456948:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571968:12345-0@lo:502: 00000100:00100000:1.0:1788574082.457143:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747571968:12345-0@lo:502: Request processed in 196us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.457150:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788574082.457216:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747571968:0@lo:502: 00000040:00080000:0.0:1788574082.457546:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788574082.457596:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788574082.457631:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788574082.457680:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788574082.457719:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788574082.457779:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788574082.457831:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788574082.457880:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788574082.457931:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788574082.457970:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788574082.458007:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788574082.458056:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788574082.458106:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788574082.458142:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788574082.458201:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788574082.458241:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788574082.458277:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788574082.458347:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788574082.458411:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788574082.458448:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788574082.458508:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788574082.458549:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788574082.458584:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788574082.458634:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788574082.458672:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788574082.458707:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788574082.458754:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788574082.458805:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788574082.458856:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788574082.458905:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788574082.458941:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788574082.458972:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788574082.459002:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788574082.459048:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788574082.459086:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788574082.459129:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788574082.459163:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788574082.459205:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747572096:0@lo:502: 00000100:00100000:0.0:1788574082.459273:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.459956:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572096 00000100:00100000:3.0:1788574082.459964:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572096 00000100:00100000:3.0:1788574082.460003:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788574082.460011:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747572096:12345-0@lo:502: 00000100:00100000:3.0:1788574082.460222:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747572096:12345-0@lo:502: Request processed in 211us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.460239:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574082.460592:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574082.460613:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747572096:0@lo:502: 00000040:00080000:0.0:1788574082.460693:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788574082.460703:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788574082.464518:0:7671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788574082.464537:0:7671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a79241cd40) 00000020:00000080:0.0:1788574082.464558:0:7671:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788574082.464659:0:7671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6812f6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788574082.464663:0:7671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6812f6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788574082.464672:0:7671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6812f6000 3 00010000:00080000:0.0:1788574082.464701:0:7671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7a773a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788574082.468268:0:7671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788574082.469141:0:7671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788574082.469177:0:7671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574082.469189:0:7671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x10531a153b535807 00000100:00080000:0.0:1788574082.469198:0:7671:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574082.469204:0:7671:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a7a773a000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574082.469239:0:7671:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a792459f80 x1875455747572224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574082.469305:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747572224:0@lo:38: 00000100:00100000:1.0:1788574082.469397:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.469494:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572224 00000100:00100000:3.0:1788574082.469501:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572224 00000100:00100000:3.0:1788574082.469532:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574082.469539:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747572224:12345-0@lo:38: 00010000:00080000:3.0:1788574082.469559:0:5857:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788574082.469588:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x10531a153b53580e 00000004:00100000:3.0:1788574082.469602:0:5857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574082.469643:0:5857:0:(import.c:65:import_set_state_nolock()) ffff90a79e97a800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788574082.469905:0:7671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788574082.470424:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574082.470442:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747572608:0@lo:400: 00000100:00100000:0.0:1788574082.470507:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574082.472546:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572608 00000100:00100000:2.0:1788574082.472558:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572608 00000100:00100000:2.0:1788574082.472629:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574082.472640:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747572608:12345-0@lo:400: 00000100:00100000:2.0:1788574082.472719:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747572608:12345-0@lo:400: Request processed in 81us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574082.472726:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788574082.472756:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574082.472849:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a792458700 x1875455747572608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574082.472865:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747572608:0@lo:400: 00000100:00100000:3.0:1788574082.475714:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875455747572224:12345-0@lo:38: Request processed in 6164us (6306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.475727:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574082.475775:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747572352:0@lo:400: 00000100:00100000:3.0:1788574082.475840:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.475873:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574082.475879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747572480:0@lo:400: 00000100:00100000:3.0:1788574082.475901:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.475934:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572352 00000100:00100000:3.0:1788574082.475941:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572352 00000100:00100000:3.0:1788574082.475974:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572480 00000100:00100000:3.0:1788574082.475977:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572480 00000100:00100000:3.0:1788574082.476002:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574082.476009:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747572352:12345-0@lo:400: 00000100:00100000:3.0:1788574082.476057:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747572352:12345-0@lo:400: Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.476063:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574082.476087:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574082.476093:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747572480:12345-0@lo:400: 00000100:00100000:3.0:1788574082.476133:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747572480:12345-0@lo:400: Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.476139:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788574082.476174:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a79245bb80 x1875455747572480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574082.476187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747572480:0@lo:400: 00010000:00080000:3.0:1788574082.476198:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a79245a300 x1875455747572352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574082.476207:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747572352:0@lo:400: 00000100:00080000:2.0:1788574082.476425:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788574082.478399:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a792459f80 x1875455747572224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574082.478413:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574082.478422:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788574082.478431:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574082.478436:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574082.478440:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7a773a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574082.478446:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747572224:0@lo:38: 00000040:00080000:0.0:1788574082.478922:0:7671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788574082.479063:0:7658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788574082.479089:0:7658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574082.479109:0:7658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574082.479120:0:7658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574082.479194:0:7658:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788574082.479196:0:7658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574082.479198:0:7658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574082.479199:0:7658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574082.479200:0:7658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574082.479201:0:7658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574082.479203:0:7658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574082.479205:0:7658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788574082.479206:0:7658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788574082.479208:0:7658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574082.479209:0:7658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574082.479214:0:7658:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788574082.479217:0:7658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574082.479218:0:7658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574082.479219:0:7658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574082.479220:0:7658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574082.479221:0:7658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574082.479222:0:7658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574082.479223:0:7658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574082.479224:0:7658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788574082.479225:0:7658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788574082.479226:0:7658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574082.479227:0:7658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574082.479250:0:7658:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788574082.479848:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747572736:0@lo:253: 00000100:00100000:1.0:1788574082.479918:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574082.479960:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ffe540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574082.480011:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572736 00000100:00100000:0.0:1788574082.480019:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572736 00000100:00100000:0.0:1788574082.480064:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574082.480074:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:7658:x1875455747572736:12345-0@lo:253: 20000000:01000000:0.0:1788574082.480098:0:5849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788574082.480110:0:5849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788574082.480861:0:7673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7673:1875455747572864:0@lo:901: 00000100:00100000:2.0:1788574082.480906:0:7673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574082.480924:0:7673:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e38780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574082.481015:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572864 00000100:00100000:1.0:1788574082.481022:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572864 00000100:00100000:1.0:1788574082.481076:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574082.481083:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7673:x1875455747572864:12345-0@lo:901: 00000100:00100000:1.0:1788574082.481590:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7673:x1875455747572864:12345-0@lo:901: Request processed in 506us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574082.481598:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788574082.481673:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574082.484578:0:7673:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bb28aa00 x1875455747572864/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788574098 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574082.484597:0:7673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7673:1875455747572864:0@lo:901: 20000000:01000000:3.0:1788574082.511598:0:5849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788574082.511618:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788574082.511715:0:5873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574082.511720:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574082.511741:0:5873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.511775:0:5873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53575f expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.511783:0:5873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.511848:0:5873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53575f expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.511863:0:5873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53575f expref: 14 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.511878:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1875455747572992:0@lo:104: 00000100:00100000:0.0:1788574082.511944:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574082.511991:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574082.512123:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747572992 00000100:00100000:3.0:1788574082.512130:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747572992 00000100:00100000:3.0:1788574082.512182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574082.512192:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:5873:x1875455747572992:12345-0@lo:104: 00010000:00010000:3.0:1788574082.512206:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512263:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574082.512280:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:5873:x1875455747572992:12345-0@lo:104: Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.512287:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788574082.512310:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574082.512316:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512524:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574082.512529:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512537:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574082.512545:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574082.512550:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574082.512586:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512593:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574082.512609:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512616:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53575f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512636:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.512638:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574082.512640:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574082.512651:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747573120:0@lo:103: 00000100:00100000:3.0:1788574082.512683:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.512720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573120 00000100:00100000:3.0:1788574082.512724:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573120 00010000:00010000:3.0:1788574082.512741:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53575f expref: 15 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.512772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574082.512779:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79260bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+15:3315:x1875455747573120:12345-0@lo:103: 00010000:00010000:3.0:1788574082.512800:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574082.512806:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53575f expref: 15 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512817:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53575f expref: 15 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512834:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512841:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788574082.512854:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001134764s 00010000:00010000:3.0:1788574082.512858:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512865:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512873:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512879:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512885:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574082.512889:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512904:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512913:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574082.512923:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574082.512954:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79260bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+15:3315:x1875455747573120:12345-0@lo:103: Request processed in 176us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.512961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574082.513021:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747573120:0@lo:103: 00010000:00010000:0.0:1788574082.513138:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21600/0x10531a153b535766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53575f expref: 14 pid: 5852 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574082.513148:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1875455747572992:0@lo:104: 00010000:00010000:0.0:1788574082.513162:0:5873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.513169:0:5873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.513175:0:5873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574082.513181:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b535815 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574082.520538:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:7658:x1875455747572736:12345-0@lo:253: Request processed in 40457us (40611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.520553:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574082.520683:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a547233-5b7a-4801-b1c0-26875afe1265:7658:1875455747572736:0@lo:253: 10000000:01000000:0.0:1788574082.520698:0:7658:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788574082.520702:0:7658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574082.520703:0:7658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574082.520705:0:7658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574082.520706:0:7658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574082.520708:0:7658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574082.520709:0:7658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574082.520710:0:7658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574082.520712:0:7658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574082.520713:0:7658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574082.520715:0:7658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574082.520716:0:7658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788574082.520731:0:7658:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788574082.525168:0:7658:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574082.525411:0:7658:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574082.525624:0:7658:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574082.525826:0:7658:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574082.526047:0:7658:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574082.526279:0:7658:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788574082.527923:0:7658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788574082.822340:0:7658:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788574082.822348:0:7658:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788574082.822405:0:7658:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788574082.822462:0:7658:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788574082.822475:0:7658:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788574082.822503:0:7658:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1788574083.205257:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747573248:0@lo:13: 00000100:00100000:3.0:1788574083.205339:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.205599:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573248 00000100:00100000:2.0:1788574083.205608:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573248 00000100:00100000:2.0:1788574083.205671:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574083.205682:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747573248:12345-0@lo:13: 00002000:00000024:2.0:1788574083.205716:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574083.208818:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747573248:12345-0@lo:13: Request processed in 3128us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.208833:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788574083.211727:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bd10e680 x1875455747573248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574083.211758:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747573248:0@lo:13: 00010000:00010000:3.0:1788574083.397601:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574084.422581:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574085.442967:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574086.469625:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574087.494208:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574087.820349:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747573376:0@lo:400: 00000100:00100000:1.0:1788574087.820349:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747573760:0@lo:400: 00000100:00100000:0.0:1788574087.820540:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747573504:0@lo:400: 00000100:00100000:1.0:1788574087.832959:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574087.833062:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747573632:0@lo:400: 00000100:00100000:1.0:1788574087.833107:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574087.833143:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573760 00000100:00100000:1.0:1788574087.833151:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573760 00000100:00100000:1.0:1788574087.833206:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574087.833216:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747573760:12345-0@lo:400: 00000100:00100000:1.0:1788574087.833269:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747573760:12345-0@lo:400: Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574087.833276:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574087.833299:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573632 00000100:00100000:1.0:1788574087.833302:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573632 00000100:00100000:1.0:1788574087.833330:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574087.833337:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747573632:12345-0@lo:400: 00000100:00100000:1.0:1788574087.833390:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747573632:12345-0@lo:400: Request processed in 54us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574087.833396:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788574087.833411:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574087.833415:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574087.833444:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10f800 x1875455747573632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574087.833458:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747573632:0@lo:400: 00010000:00080000:1.0:1788574087.833484:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10e680 x1875455747573760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574087.833509:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747573760:0@lo:400: 00000100:00100000:2.0:1788574087.837320:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574087.837404:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573376 00000100:00100000:2.0:1788574087.837413:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573376 00000100:00100000:2.0:1788574087.837470:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788574087.837480:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:3313:x1875455747573376:12345-0@lo:400: 00000100:00100000:2.0:1788574087.837557:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:3313:x1875455747573376:12345-0@lo:400: Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574087.837564:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788574087.837648:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747573376:0@lo:400: 00000100:00100000:2.0:1788574087.837659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747573888:0@lo:400: 00000100:00100000:2.0:1788574087.837688:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574087.837726:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573888 00000100:00100000:2.0:1788574087.837730:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573888 00000100:00100000:2.0:1788574087.837763:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574087.837768:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747573888:12345-0@lo:400: 00000100:00100000:2.0:1788574087.837796:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747573888:12345-0@lo:400: Request processed in 27us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574087.837802:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788574087.837817:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788574087.837837:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10d180 x1875455747573888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574087.837848:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747573888:0@lo:400: 00000100:00100000:0.0:1788574087.841152:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574087.841596:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747573504 00000100:00100000:1.0:1788574087.841606:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747573504 00000100:00100000:1.0:1788574087.841665:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574087.841676:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747573504:12345-0@lo:400: 00000100:00100000:1.0:1788574087.841754:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747573504:12345-0@lo:400: Request processed in 80us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574087.841761:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788574087.841802:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10c380 x1875455747573504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574087.841816:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747573504:0@lo:400: 00000100:00100000:2.0:1788574088.320742:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574088.320768:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747574016:0@lo:13: 00000100:00100000:2.0:1788574088.320836:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.320907:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574016 00000100:00100000:2.0:1788574088.320916:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574016 00000100:00100000:2.0:1788574088.320959:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574088.320969:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747574016:12345-0@lo:13: 00002000:00000024:2.0:1788574088.321007:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574088.321050:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747574016:12345-0@lo:13: Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.321057:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788574088.321097:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28b480 x1875455747574016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574088.321123:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747574016:0@lo:13: 00010000:00010000:3.0:1788574088.525524:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574089.544457:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574089.709572:0:8014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1788574090.369881:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788574090.369889:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a785e1b800 from 30 10000000:01000000:2.0:1788574090.369894:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574090.369949:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.369961:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.369973:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574090.369999:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574144:0@lo:101: 00000100:00100000:2.0:1788574090.370086:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.370142:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bd0f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.371809:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574144 00000100:00100000:2.0:1788574090.371823:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574144 00000100:00100000:2.0:1788574090.371888:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574090.371897:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747574144:12345-0@lo:101: 00010000:00010000:2.0:1788574090.371913:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574090.371930:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53581c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.371957:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53581c expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.371988:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53581c expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.371997:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159a00, rc 0) 00000100:00100000:2.0:1788574090.372555:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747574144:12345-0@lo:101: Request processed in 657us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.372563:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788574090.372671:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574144:0@lo:101: 00010000:00010000:0.0:1788574090.372699:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.372717:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574090.372791:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574272:0@lo:501: 00000100:00100000:0.0:1788574090.372824:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.372862:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.372964:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574272 00000100:00100000:2.0:1788574090.372969:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574272 00000100:00100000:2.0:1788574090.373002:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788574090.373010:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747574272:12345-0@lo:501: 00000100:00100000:2.0:1788574090.374142:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747574272:12345-0@lo:501: Request processed in 1127us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.374153:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788574090.374810:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574272:0@lo:501: 00000100:00100000:2.0:1788574090.374863:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574400:0@lo:503: 00000100:00100000:2.0:1788574090.374921:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.374940:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bd0f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.374957:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574400 00000100:00100000:2.0:1788574090.374962:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574400 00000100:00100000:2.0:1788574090.374997:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788574090.375006:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747574400:12345-0@lo:503: 00000100:00100000:2.0:1788574090.378060:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747574400:12345-0@lo:503: Request processed in 3047us (3132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.378072:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788574090.381938:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574400:0@lo:503: 00000100:00100000:2.0:1788574090.389021:0:8042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8042:1875455747574528:0@lo:502: 00000100:00100000:2.0:1788574090.389121:0:8042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.389165:0:8042:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.389282:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574528 00000100:00100000:1.0:1788574090.389290:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574528 00000100:00100000:1.0:1788574090.389336:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574090.389347:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:8042:x1875455747574528:12345-0@lo:502: 00000100:00100000:1.0:1788574090.389669:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:8042:x1875455747574528:12345-0@lo:502: Request processed in 323us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.389677:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788574090.392336:0:8042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8042:1875455747574528:0@lo:502: 00000100:00100000:2.0:1788574090.392457:0:8042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8042:1875455747574656:0@lo:502: 00000100:00100000:2.0:1788574090.392523:0:8042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.392564:0:8042:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574090.392645:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574656 00000100:00100000:0.0:1788574090.392651:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574656 00000100:00100000:0.0:1788574090.392715:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788574090.392725:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:8042:x1875455747574656:12345-0@lo:502: 00000100:00100000:0.0:1788574090.392958:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:8042:x1875455747574656:12345-0@lo:502: Request processed in 234us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.392965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788574090.393296:0:8042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8042:1875455747574656:0@lo:502: 00000040:00080000:2.0:1788574090.393320:0:8042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788574090.394084:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788574090.394108:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574090.394119:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.394132:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574090.394144:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788574090.394147:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788574090.394150:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574090.394179:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.394206:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.394217:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574090.394235:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574784:0@lo:101: 00000100:00100000:0.0:1788574090.394276:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.394309:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.394456:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574784 00000100:00100000:2.0:1788574090.394462:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574784 00000100:00100000:2.0:1788574090.394497:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574090.394505:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747574784:12345-0@lo:101: 00010000:00010000:2.0:1788574090.394515:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574090.394528:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53582a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.394549:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53582a expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.394560:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53582a expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.394568:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2158400, rc 0) 00000100:00100000:2.0:1788574090.394608:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747574784:12345-0@lo:101: Request processed in 103us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.394623:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788574090.394694:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574784:0@lo:101: 00010000:00010000:1.0:1788574090.394717:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574090.394726:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574090.394781:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574912:0@lo:501: 00000100:00100000:1.0:1788574090.394808:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574090.394832:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.394921:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747574912 00000100:00100000:2.0:1788574090.394925:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747574912 00000100:00100000:2.0:1788574090.394954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574090.394960:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747574912:12345-0@lo:501: 00000100:00100000:2.0:1788574090.395178:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747574912:12345-0@lo:501: Request processed in 218us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.395197:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574090.395225:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747574912:0@lo:501: 00000100:00100000:2.0:1788574090.395250:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575040:0@lo:503: 00000100:00100000:2.0:1788574090.395283:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.395295:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.395305:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575040 00000100:00100000:2.0:1788574090.395308:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575040 00000100:00100000:2.0:1788574090.395323:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788574090.395328:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747575040:12345-0@lo:503: 00000100:00100000:2.0:1788574090.395614:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747575040:12345-0@lo:503: Request processed in 284us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.395621:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788574090.395682:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575040:0@lo:503: 00000100:00100000:2.0:1788574090.395857:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8043:1875455747575168:0@lo:502: 00000100:00100000:2.0:1788574090.395888:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.395905:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575168 00000100:00100000:2.0:1788574090.395909:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575168 00000100:00100000:2.0:1788574090.395926:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788574090.395939:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8043:x1875455747575168:12345-0@lo:502: 00000100:00100000:2.0:1788574090.396081:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8043:x1875455747575168:12345-0@lo:502: Request processed in 142us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.396088:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788574090.396112:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.396124:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8043:1875455747575168:0@lo:502: 00000020:01000000:2.0:1788574090.396145:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574090.396154:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574090.396156:0:8043:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574090.396161:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574090.396163:0:8043:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788574090.396177:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8043:1875455747575296:0@lo:502: 00000100:00100000:2.0:1788574090.396210:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.396227:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575296 00000100:00100000:2.0:1788574090.396230:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575296 00000100:00100000:2.0:1788574090.396244:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574090.396249:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8043:x1875455747575296:12345-0@lo:502: 00000100:00100000:2.0:1788574090.396340:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8043:x1875455747575296:12345-0@lo:502: Request processed in 90us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.396346:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574090.396391:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.396404:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8043:1875455747575296:0@lo:502: 00000020:01000000:2.0:1788574090.396420:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574090.396424:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574090.396426:0:8043:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788574090.396429:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788574090.396467:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788574090.396483:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788574090.396497:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396507:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574090.396517:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788574090.396520:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a790a3d000 from 30 10000000:01000000:2.0:1788574090.396522:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574090.396543:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396551:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396560:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574090.396570:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575424:0@lo:101: 00000100:00100000:2.0:1788574090.396593:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.396604:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.396614:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575424 00000100:00100000:2.0:1788574090.396617:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575424 00000100:00100000:2.0:1788574090.396632:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788574090.396637:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747575424:12345-0@lo:101: 00010000:00010000:2.0:1788574090.396644:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574090.396677:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535838 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396697:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535838 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396713:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535838 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396721:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984800, rc 0) 00000100:00100000:2.0:1788574090.396746:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747575424:12345-0@lo:101: Request processed in 109us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.396752:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788574090.396779:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575424:0@lo:101: 00010000:00010000:2.0:1788574090.396789:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574090.396797:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574090.396829:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575552:0@lo:501: 00000100:00100000:2.0:1788574090.396851:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.396863:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.396873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575552 00000100:00100000:2.0:1788574090.396876:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575552 00000100:00100000:2.0:1788574090.396891:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788574090.396896:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747575552:12345-0@lo:501: 00000100:00100000:2.0:1788574090.397061:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747575552:12345-0@lo:501: Request processed in 163us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.397067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788574090.397094:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575552:0@lo:501: 00000100:00100000:2.0:1788574090.397116:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575680:0@lo:503: 00000100:00100000:2.0:1788574090.397151:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.397162:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.397172:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575680 00000100:00100000:2.0:1788574090.397175:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575680 00000100:00100000:2.0:1788574090.397190:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788574090.397195:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747575680:12345-0@lo:503: 00000100:00100000:2.0:1788574090.397306:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747575680:12345-0@lo:503: Request processed in 110us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.397313:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788574090.397344:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747575680:0@lo:503: 00000100:00100000:0.0:1788574090.404279:0:8044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8044:1875455747575808:0@lo:502: 00000100:00100000:0.0:1788574090.408358:0:8044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.408435:0:8044:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.408547:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575808 00000100:00100000:2.0:1788574090.408556:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575808 00000100:00100000:2.0:1788574090.408607:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788574090.408617:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:8044:x1875455747575808:12345-0@lo:502: 00000100:00100000:2.0:1788574090.408942:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:8044:x1875455747575808:12345-0@lo:502: Request processed in 326us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.408950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574090.413465:0:8044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8044:1875455747575808:0@lo:502: 00000100:00100000:1.0:1788574090.413559:0:8044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8044:1875455747575936:0@lo:502: 00000100:00100000:1.0:1788574090.413631:0:8044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574090.413684:0:8044:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574090.413869:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747575936 00000100:00100000:0.0:1788574090.413876:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747575936 00000100:00100000:0.0:1788574090.413927:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574090.413937:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:8044:x1875455747575936:12345-0@lo:502: 00000100:00100000:0.0:1788574090.414474:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:8044:x1875455747575936:12345-0@lo:502: Request processed in 535us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.414482:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788574090.414635:0:8044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8044:1875455747575936:0@lo:502: 00000040:00080000:1.0:1788574090.414673:0:8044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788574090.414828:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788574090.414848:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788574090.414860:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.414878:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574090.414888:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574090.414891:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a790a3d000 from 5 10000000:01000000:3.0:1788574090.414894:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574090.414922:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.414931:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.414940:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574090.414955:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576064:0@lo:101: 00000100:00100000:3.0:1788574090.414986:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.415007:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574090.416210:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576064 00000100:00100000:0.0:1788574090.416222:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576064 00000100:00100000:0.0:1788574090.416273:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788574090.416282:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747576064:12345-0@lo:101: 00010000:00010000:0.0:1788574090.416297:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574090.416314:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4c400/0x10531a153b53584d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535846 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.416355:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4c400/0x10531a153b53584d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535846 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.416365:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4c400/0x10531a153b53584d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535846 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.416396:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c400, rc 0) 00000100:00100000:0.0:1788574090.416455:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747576064:12345-0@lo:101: Request processed in 174us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.416461:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788574090.416608:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576064:0@lo:101: 00010000:00010000:3.0:1788574090.416623:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.416633:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574090.416702:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576192:0@lo:256: 00000100:00100000:3.0:1788574090.416737:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.416777:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.416900:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576192 00000100:00100000:1.0:1788574090.416904:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576192 00000100:00100000:1.0:1788574090.416939:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788574090.416947:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747576192:12345-0@lo:256: 20000000:01000000:1.0:1788574090.416961:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574090.416980:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574090.416983:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788574090.417055:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747576192:12345-0@lo:256: Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.417061:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788574090.417124:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576192:0@lo:256: 10000000:01000000:3.0:1788574090.417164:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574090.417171:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.417179:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574090.417253:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788574090.417255:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788574090.417258:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788574090.417276:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.417284:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.417293:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574090.417305:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576320:0@lo:101: 00000100:00100000:3.0:1788574090.417328:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.417348:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574090.417419:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576320 00000100:00100000:0.0:1788574090.417424:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576320 00000100:00100000:0.0:1788574090.417444:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788574090.417450:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747576320:12345-0@lo:101: 00010000:00010000:0.0:1788574090.417457:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574090.417467:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535854 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.417482:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535854 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.417491:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535854 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574090.417499:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d400, rc 0) 00000100:00100000:0.0:1788574090.417527:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747576320:12345-0@lo:101: Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.417532:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788574090.417644:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576320:0@lo:101: 00010000:00010000:3.0:1788574090.417664:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.417672:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574090.417731:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576448:0@lo:501: 00000100:00100000:3.0:1788574090.417755:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.417773:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.417879:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576448 00000100:00100000:1.0:1788574090.417883:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576448 00000100:00100000:1.0:1788574090.417912:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574090.417919:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747576448:12345-0@lo:501: 00000100:00100000:1.0:1788574090.418402:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747576448:12345-0@lo:501: Request processed in 482us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.418419:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788574090.418552:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576448:0@lo:501: 00000100:00100000:3.0:1788574090.418581:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576576:0@lo:503: 00000100:00100000:3.0:1788574090.418616:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.418642:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.418843:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576576 00000100:00100000:1.0:1788574090.418849:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576576 00000100:00100000:1.0:1788574090.418919:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574090.418927:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747576576:12345-0@lo:503: 00000100:00100000:1.0:1788574090.419517:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747576576:12345-0@lo:503: Request processed in 588us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.419524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788574090.419607:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747576576:0@lo:503: 00000100:00100000:2.0:1788574090.425881:0:8046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8046:1875455747576704:0@lo:502: 00000100:00100000:2.0:1788574090.425968:0:8046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.426203:0:8046:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792212840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574090.436868:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576704 00000100:00100000:0.0:1788574090.436885:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576704 00000100:00100000:0.0:1788574090.436950:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574090.436961:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:8046:x1875455747576704:12345-0@lo:502: 00000100:00100000:0.0:1788574090.437473:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:8046:x1875455747576704:12345-0@lo:502: Request processed in 512us (11503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.437482:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788574090.438903:0:8046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8046:1875455747576704:0@lo:502: 00000020:01000000:2.0:1788574090.438949:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574090.438958:0:8046:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788574090.438967:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574090.438969:0:8046:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788574090.438974:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574090.438989:0:8046:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:2.0:1788574090.439014:0:8046:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788574090.439017:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574090.439042:0:8046:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a793288000) 00000020:00000080:2.0:1788574090.439065:0:8046:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788574090.439072:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788574090.439162:0:8046:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788574090.439168:0:8046:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788574090.439173:0:8046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b535869 00010000:00080000:2.0:1788574090.439209:0:8046:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a78f4f9800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788574090.439440:0:8046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788574090.440407:0:8046:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788574090.440423:0:8046:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788574090.446482:0:8046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574090.449544:0:8046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574090.449616:0:8046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788574090.449691:0:8046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788574090.462852:0:8047:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574090.462862:0:8047:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788574090.463423:0:8046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788574090.463437:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788574090.463471:0:8046:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788574090.463493:0:8046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b535870 00000100:00080000:3.0:1788574090.463504:0:8046:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574090.463510:0:8046:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a78f4f9800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574090.463544:0:8046:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a79e88b800 x1875455747576832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574090.463564:0:8046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788574090.463619:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574090.463623:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574090.463625:0:8046:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788574090.463628:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574090.463632:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574090.463633:0:8046:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574090.463636:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574090.463638:0:8046:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788574090.463673:0:8046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8046:1875455747576960:0@lo:502: 00000100:00100000:3.0:1788574090.463929:0:8046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.463965:0:8046:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.464093:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747576832:0@lo:8: 00000100:00100000:1.0:1788574090.464141:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.464384:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576960 00000100:00100000:0.0:1788574090.464391:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576960 00000100:00100000:0.0:1788574090.464430:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788574090.464439:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:8046:x1875455747576960:12345-0@lo:502: 00000100:00100000:0.0:1788574090.464669:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:8046:x1875455747576960:12345-0@lo:502: Request processed in 231us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.464677:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788574090.464826:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747577088:0@lo:400: 00000100:00100000:1.0:1788574090.464856:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574090.464877:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574090.464882:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747577472:0@lo:400: 00000100:00100000:1.0:1788574090.464900:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574090.464929:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577088 00000100:00100000:1.0:1788574090.464932:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577088 00000100:00100000:1.0:1788574090.464956:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577472 00000100:00100000:1.0:1788574090.464959:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577472 00000100:00100000:1.0:1788574090.464979:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574090.464985:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747577088:12345-0@lo:400: 00000100:00100000:1.0:1788574090.465018:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747577088:12345-0@lo:400: Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.465024:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574090.465046:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574090.465051:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747577472:12345-0@lo:400: 00000100:00100000:1.0:1788574090.465077:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747577472:12345-0@lo:400: Request processed in 27us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.465083:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788574090.465100:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788574090.465123:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a792458380 x1875455747577472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574090.465135:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747577472:0@lo:400: 00010000:00080000:1.0:1788574090.465145:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a792458e00 x1875455747577088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574090.465153:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747577088:0@lo:400: 00000100:00100000:0.0:1788574090.465288:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747577216:0@lo:400: 00000100:00100000:0.0:1788574090.465314:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.465337:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574090.465343:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747577344:0@lo:400: 00000100:00100000:0.0:1788574090.465363:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.465428:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577216 00000100:00100000:0.0:1788574090.465433:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577216 00000100:00100000:0.0:1788574090.465461:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574090.465467:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747577216:12345-0@lo:400: 00000100:00100000:0.0:1788574090.465500:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747577216:12345-0@lo:400: Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.465506:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574090.465524:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747576832 00000100:00100000:0.0:1788574090.465533:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747576832 00000100:00100000:0.0:1788574090.465549:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577344 00000100:00100000:0.0:1788574090.465552:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577344 00000100:00100000:0.0:1788574090.465569:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574090.465574:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747577344:12345-0@lo:400: 00000100:00100000:0.0:1788574090.465601:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747577344:12345-0@lo:400: Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.465606:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574090.465617:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574090.465622:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747576832:12345-0@lo:8: 00010000:00080000:0.0:1788574090.465642:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788574090.465678:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b535877 00000100:00100000:3.0:1788574090.468394:0:8046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8046:1875455747576960:0@lo:502: 00000020:01000000:3.0:1788574090.468448:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574090.468458:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574090.468461:0:8046:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788574090.468470:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788574090.468610:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788574090.468628:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788574090.468640:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.468662:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574090.468675:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788574090.468678:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a792418000 from 1 10000000:01000000:3.0:1788574090.468685:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788574090.468786:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.468795:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.468805:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574090.468827:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747577600:0@lo:101: 00000100:00100000:3.0:1788574090.468892:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.468943:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574090.468959:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577600 00000100:00100000:3.0:1788574090.468965:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577600 00000100:00100000:3.0:1788574090.469010:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788574090.469020:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747577600:12345-0@lo:101: 00010000:00010000:3.0:1788574090.469033:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574090.469046:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53587e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.469070:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53587e expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.469080:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53587e expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.469089:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165aa00, rc 0) 00000100:00100000:3.0:1788574090.469124:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747577600:12345-0@lo:101: Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574090.469130:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788574090.469165:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747577600:0@lo:101: 00010000:00010000:3.0:1788574090.469176:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788574090.469809:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a7a7738800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788574090.469814:0:6712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788574090.469819:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788574090.469945:0:6712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788574090.470094:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788574090.470122:0:6712:0:(import.c:65:import_set_state_nolock()) ffff90a7a773f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574090.470178:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875455747576832:12345-0@lo:8: Request processed in 4554us (6035us total) trans 0 rc 0/0 00010000:00010000:3.0:1788574090.471832:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574090.471929:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747577728:0@lo:501: 00000100:00100000:3.0:1788574090.471986:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.472012:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574090.472047:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577728 00000100:00100000:3.0:1788574090.472053:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577728 00000100:00100000:3.0:1788574090.472085:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788574090.472095:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747577728:12345-0@lo:501: 00000100:00100000:0.0:1788574090.473283:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788574090.473317:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574090.473322:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574090.473362:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a792459c00 x1875455747577344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574090.473523:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747577344:0@lo:400: 00010000:00080000:0.0:1788574090.473541:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79245b480 x1875455747577216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574090.473559:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747577216:0@lo:400: 00010000:00080000:0.0:1788574090.473601:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e88b800 x1875455747576832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574090.473609:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574090.473618:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788574090.473626:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788574090.473631:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788574090.473634:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a78f4f9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788574090.473668:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788574090.473673:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747576832:0@lo:8: 00000004:00080000:0.0:1788574090.473692:0:8047:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788574090.474532:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747577728:12345-0@lo:501: Request processed in 2436us (2544us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574090.474544:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788574090.474671:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747577728:0@lo:501: 00000004:00080000:0.0:1788574090.475388:0:8047:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 216649996187ns, next at 0ns, rc = 0 10000000:01000000:3.0:1788574090.477901:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788574090.477919:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574090.477931:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574090.556590:0:8050:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788574090.556622:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747577984:0@lo:7: 00000100:00100000:1.0:1788574090.556812:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574090.556858:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.556877:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577984 00000100:00100000:1.0:1788574090.556884:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577984 00000100:00100000:1.0:1788574090.556933:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574090.556942:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8050:x1875455747577984:12345-0@lo:7: 00000004:00080000:2.0:1788574090.557839:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788574090.557981:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747577856:0@lo:13: 00000100:00100000:3.0:1788574090.558029:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.558357:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747577856 00000100:00100000:2.0:1788574090.558364:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747577856 00000100:00100000:2.0:1788574090.558429:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574090.558438:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747577856:12345-0@lo:13: 00002000:00000024:2.0:1788574090.558463:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788574090.558510:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747577856:12345-0@lo:13: Request processed in 74us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.558518:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788574090.558558:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10e300 x1875455747577856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574090.558577:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747577856:0@lo:13: 00000100:00080000:0.0:1788574090.558830:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788574090.569552:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788574090.569674:0:6711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788574090.569808:0:6711:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788574090.569914:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8050:x1875455747577984:12345-0@lo:7: Request processed in 12968us (13098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.569927:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788574090.570013:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10df80 x1875455747577984/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574106 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574090.570091:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747577984:0@lo:7: 00000004:00080000:2.0:1788574090.570105:0:8050:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788574090.570399:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747578112:0@lo:5: 00000100:00100000:2.0:1788574090.570616:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.570668:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574090.570867:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578112 00000100:00100000:1.0:1788574090.570885:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578112 00000100:00100000:1.0:1788574090.570934:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574090.570943:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8050:x1875455747578112:12345-0@lo:5: 00002000:00080000:1.0:1788574090.570969:0:6713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788574090.570973:0:6713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788574090.571876:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8050:x1875455747578112:12345-0@lo:5: Request processed in 930us (1256us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788574090.571886:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788574090.571963:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28ad80 x1875455747578112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574106 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574090.571977:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747578112:0@lo:5: 00000004:00080000:1.0:1788574090.571988:0:8050:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788574090.572019:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747578240:0@lo:700: 00000100:00100000:1.0:1788574090.572114:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574090.572138:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574090.572250:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578240 00000100:00100000:3.0:1788574090.572256:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578240 00000100:00100000:3.0:1788574090.572295:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574090.572303:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8050:x1875455747578240:12345-0@lo:700: 00000100:00100000:3.0:1788574090.572331:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6720:1875455747578368:0@lo:700: 00000100:00100000:3.0:1788574090.572361:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574090.572403:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574090.572548:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578368 00000100:00100000:2.0:1788574090.572552:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578368 00000100:00100000:2.0:1788574090.572587:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574090.572594:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6720:x1875455747578368:12345-0@lo:700: 40000000:02000000:2.0:1788574090.604264:0:5864:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788574090.609902:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6720:x1875455747578368:12345-0@lo:700: Request processed in 37298us (37529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574090.609923:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788574090.610006:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e88b100 x1875455747578368/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788574106 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574090.610023:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6720:1875455747578368:0@lo:700: 40000000:02000000:3.0:1788574090.610116:0:6720:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788574090.735136:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8050:x1875455747578240:12345-0@lo:700: Request processed in 162824us (163012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574090.735152:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:3.0:1788574090.735288:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788574090.735304:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:3.0:1788574090.735358:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10df80 x1875455747578240/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788574106 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574090.735436:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747578240:0@lo:700: 00000004:02000040:3.0:1788574090.788267:0:8050:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788574090.792513:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747578496:0@lo:5: 00000100:00100000:3.0:1788574090.793778:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574090.793819:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578496 00000100:00100000:0.0:1788574090.793828:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578496 00000100:00100000:3.0:1788574090.793833:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574090.793910:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574090.793921:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8050:x1875455747578496:12345-0@lo:5: 00002000:00080000:3.0:1788574090.801030:0:6711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788574090.801052:0:6711:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788574090.805324:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8050:x1875455747578496:12345-0@lo:5: Request processed in 11399us (11540us total) trans 4294967298 rc 0/0 00010000:00080000:2.0:1788574090.805450:0:8050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e88b100 x1875455747578496/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574106 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574090.805465:0:8050:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788574090.805481:0:8050:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90a79e88b100 x1875455747578496/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574106 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574090.805493:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8050:1875455747578496:0@lo:5: 00000004:00080000:2.0:1788574090.805507:0:8050:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788574090.805523:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788574091.586942:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574092.608925:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574093.442099:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747578624:0@lo:13: 00000100:00100000:0.0:1788574093.442174:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.442362:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578624 00000100:00100000:1.0:1788574093.442673:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578624 00000100:00100000:1.0:1788574093.442816:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574093.442827:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747578624:12345-0@lo:13: 00002000:00000024:1.0:1788574093.442866:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574093.442921:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747578624:12345-0@lo:13: Request processed in 96us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.442940:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788574093.443032:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574093.443105:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28ad80 x1875455747578624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574093.443129:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747578624:0@lo:13: 00010000:00010000:2.0:1788574093.640695:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574094.657571:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788574094.847319:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788574095.394766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574095.395607:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727632512 00000100:00100000:1.0:1788574095.395619:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727632512 00000100:00100000:1.0:1788574095.395666:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 111 00000100:00100000:1.0:1788574095.395682:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1875455727632512:12345-192.168.201.57@tcp:250: 00010000:00080000:1.0:1788574095.395711:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ec16a69b-cbad-484e-9f31-b00eca338977@192.168.201.57@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1788574095.395738:0:5852:0:(genops.c:1385:class_connect()) connect: client ec16a69b-cbad-484e-9f31-b00eca338977, cookie 0x10531a153b53588c 00000100:00080000:1.0:1788574095.395876:0:5852:0:(import.c:65:import_set_state_nolock()) ffff90a79229e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574095.395955:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+5:2352:x1875455727632512:12345-192.168.201.57@tcp:250: Request processed in 272us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574095.395964:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 111 00000100:00100000:1.0:1788574095.414154:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574095.414233:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727632640 00000100:00100000:3.0:1788574095.414244:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727632640 00000100:00100000:3.0:1788574095.414300:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 112 00000100:00100000:3.0:1788574095.414311:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+5:5581:x1875455727632640:12345-192.168.201.57@tcp:101: 00010000:00010000:3.0:1788574095.414339:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574095.414389:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce366a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574095.414420:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574095.414431:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574095.414440:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b400, rc 0) 00000100:00100000:3.0:1788574095.414491:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+6:5581:x1875455727632640:12345-192.168.201.57@tcp:101: Request processed in 181us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574095.414498:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 112 00000100:00100000:3.0:1788574095.418623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574095.418706:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727632768 00000100:00100000:2.0:1788574095.418717:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727632768 00000100:00100000:2.0:1788574095.418773:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:2.0:1788574095.418783:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+6:5581:x1875455727632768:12345-192.168.201.57@tcp:501: 00000100:00100000:2.0:1788574095.419056:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+6:5581:x1875455727632768:12345-192.168.201.57@tcp:501: Request processed in 273us (442us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574095.419064:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:0.0:1788574095.432888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574095.438650:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727632896 00000100:00100000:1.0:1788574095.438665:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727632896 00000100:00100000:1.0:1788574095.438717:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:1.0:1788574095.438727:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+6:5581:x1875455727632896:12345-192.168.201.57@tcp:101: 00010000:00010000:1.0:1788574095.438744:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574095.438762:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3671 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574095.438791:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574095.438802:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574095.438810:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21600, rc 0) 00000100:00100000:1.0:1788574095.438881:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+7:5581:x1875455727632896:12345-192.168.201.57@tcp:101: Request processed in 155us (6003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574095.438888:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:1.0:1788574095.440938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574095.441037:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633024 00000100:00100000:3.0:1788574095.441046:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633024 00000100:00100000:3.0:1788574095.441094:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:3.0:1788574095.441112:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+7:5581:x1875455727633024:12345-192.168.201.57@tcp:501: 00000100:00100000:3.0:1788574095.441596:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+8:5581:x1875455727633024:12345-192.168.201.57@tcp:501: Request processed in 491us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574095.441604:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:3.0:1788574095.449555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574095.450197:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633152 00000100:00100000:2.0:1788574095.450209:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633152 00000100:00100000:2.0:1788574095.450267:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:2.0:1788574095.450277:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+8:5581:x1875455727633152:12345-192.168.201.57@tcp:503: 00000100:00100000:2.0:1788574095.450759:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+8:5581:x1875455727633152:12345-192.168.201.57@tcp:503: Request processed in 480us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.450768:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:2.0:1788574095.454364:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574095.454641:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633280 00000100:00100000:3.0:1788574095.454651:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633280 00000100:00100000:3.0:1788574095.454705:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:3.0:1788574095.454715:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+8:5600:x1875455727633280:12345-192.168.201.57@tcp:502: 00000100:00100000:3.0:1788574095.455039:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+8:5600:x1875455727633280:12345-192.168.201.57@tcp:502: Request processed in 324us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574095.455057:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:2.0:1788574095.491817:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747579136:0@lo:400: 00000100:00100000:2.0:1788574095.491895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574095.491963:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788574095.491970:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747578752:0@lo:400: 00000100:00100000:2.0:1788574095.491998:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574095.492023:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747579264:0@lo:400: 00000100:00100000:2.0:1788574095.492047:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574095.492075:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747579008:0@lo:400: 00000100:00100000:2.0:1788574095.492111:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574095.492131:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574095.492143:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747578880:0@lo:400: 00000100:00100000:2.0:1788574095.492167:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574095.492184:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747579392:0@lo:400: 00000100:00100000:2.0:1788574095.492204:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574095.492231:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579136 00000100:00100000:2.0:1788574095.492239:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579136 00000100:00100000:2.0:1788574095.492288:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579392 00000100:00100000:2.0:1788574095.492291:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579392 00000100:00100000:2.0:1788574095.492309:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574095.492318:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747579136:12345-0@lo:400: 00000100:00100000:2.0:1788574095.492411:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747579136:12345-0@lo:400: Request processed in 93us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.492418:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574095.492446:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574095.492453:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747579392:12345-0@lo:400: 00000100:00100000:2.0:1788574095.492484:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747579392:12345-0@lo:400: Request processed in 33us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.492491:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574095.492507:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579264 00000100:00100000:2.0:1788574095.492510:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579264 00000100:00100000:2.0:1788574095.492529:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579008 00000100:00100000:2.0:1788574095.492532:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579008 00000100:00100000:2.0:1788574095.492541:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578880 00000100:00100000:2.0:1788574095.492544:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578880 00000100:00100000:2.0:1788574095.492555:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788574095.492560:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747579264:12345-0@lo:400: 00000100:00100000:2.0:1788574095.492603:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747579264:12345-0@lo:400: Request processed in 42us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.492618:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788574095.492630:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574095.492636:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747579008:12345-0@lo:400: 00000100:00100000:2.0:1788574095.492664:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747579008:12345-0@lo:400: Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.492669:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574095.492680:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574095.492686:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747578880:12345-0@lo:400: 00000100:00100000:2.0:1788574095.492712:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747578880:12345-0@lo:400: Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.492718:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788574095.492742:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574095.492747:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574095.492749:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574095.492782:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28b480 x1875455747579264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574095.492797:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747579264:0@lo:400: 00010000:00080000:2.0:1788574095.492810:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28ad80 x1875455747579136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574095.492818:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747579136:0@lo:400: 00010000:00080000:2.0:1788574095.492846:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28a680 x1875455747578880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574095.492855:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747578880:0@lo:400: 00010000:00080000:2.0:1788574095.492865:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8ec380 x1875455747579392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574095.492879:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788574095.492891:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747579392:0@lo:400: 00010000:00080000:2.0:1788574095.492904:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28b800 x1875455747579008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574095.492913:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747579008:0@lo:400: 00000100:00100000:2.0:1788574095.492934:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747578752 00000100:00100000:2.0:1788574095.492938:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747578752 00000100:00100000:2.0:1788574095.492963:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788574095.492970:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747578752:12345-0@lo:400: 00000100:00100000:2.0:1788574095.493007:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747578752:12345-0@lo:400: Request processed in 37us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.493013:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788574095.493046:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747578752:0@lo:400: 00000100:00100000:1.0:1788574095.497257:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574095.497874:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633408 00000100:00100000:3.0:1788574095.497885:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633408 00000100:00100000:3.0:1788574095.497942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:3.0:1788574095.497953:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+8:5600:x1875455727633408:12345-192.168.201.57@tcp:502: 00000100:00100000:3.0:1788574095.498243:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+8:5600:x1875455727633408:12345-192.168.201.57@tcp:502: Request processed in 290us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574095.498252:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:0.0:1788574095.518877:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574095.520249:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633536 00000100:00100000:2.0:1788574095.520267:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633536 00000100:00100000:2.0:1788574095.520343:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:2.0:1788574095.520354:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+8:5581:x1875455727633536:12345-192.168.201.57@tcp:101: 00010000:00010000:2.0:1788574095.520394:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574095.520412:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985000/0x10531a153b5358a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce369b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574095.520453:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985000/0x10531a153b5358a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce369b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574095.520467:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985000/0x10531a153b5358a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce369b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574095.520492:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985000, rc 0) 00000100:00100000:2.0:1788574095.520561:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+9:5581:x1875455727633536:12345-192.168.201.57@tcp:101: Request processed in 208us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.520578:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:0.0:1788574095.528071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574095.528227:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633664 00000100:00100000:1.0:1788574095.528238:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633664 00000100:00100000:1.0:1788574095.528725:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:1.0:1788574095.528738:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+9:5581:x1875455727633664:12345-192.168.201.57@tcp:256: 20000000:01000000:1.0:1788574095.528766:0:5851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788574095.528785:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788574095.528789:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788574095.528793:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788574095.528795:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788574095.532934:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+9:5581:x1875455727633664:12345-192.168.201.57@tcp:256: Request processed in 4188us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.532949:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:0.0:1788574095.536183:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574095.536300:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633792 00000100:00100000:3.0:1788574095.536311:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633792 00000100:00100000:2.0:1788574095.538722:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:2.0:1788574095.538741:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+9:5581:x1875455727633792:12345-192.168.201.57@tcp:101: 00010000:00010000:2.0:1788574095.538762:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574095.538784:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce36a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574095.538813:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574095.538825:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574095.538836:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574095.538899:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:5581:x1875455727633792:12345-192.168.201.57@tcp:101: Request processed in 164us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.538906:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:3.0:1788574095.553009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574095.553656:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727633920 00000100:00100000:0.0:1788574095.553668:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727633920 00000100:00100000:0.0:1788574095.553716:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:0.0:1788574095.553726:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5581:x1875455727633920:12345-192.168.201.57@tcp:501: 00000100:00100000:0.0:1788574095.553971:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5581:x1875455727633920:12345-192.168.201.57@tcp:501: Request processed in 245us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.553979:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:3.0:1788574095.558185:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574095.559636:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634048 00000100:00100000:0.0:1788574095.559651:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634048 00000100:00100000:0.0:1788574095.559715:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788574095.559726:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5581:x1875455727634048:12345-192.168.201.57@tcp:503: 00000100:00100000:0.0:1788574095.560202:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5581:x1875455727634048:12345-192.168.201.57@tcp:503: Request processed in 476us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.560210:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788574095.575713:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574095.575794:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634176 00000100:00100000:3.0:1788574095.575803:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634176 00000100:00100000:3.0:1788574095.575857:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:3.0:1788574095.575868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:5604:x1875455727634176:12345-192.168.201.57@tcp:502: 00000100:00100000:2.0:1788574095.584985:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:5604:x1875455727634176:12345-192.168.201.57@tcp:502: Request processed in 9108us (9269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574095.584998:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:2.0:1788574095.587745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574095.589263:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634304 00000100:00100000:1.0:1788574095.589277:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634304 00000100:00100000:1.0:1788574095.589334:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:1.0:1788574095.589345:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:5604:x1875455727634304:12345-192.168.201.57@tcp:502: 00000100:00100000:1.0:1788574095.589617:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:5604:x1875455727634304:12345-192.168.201.57@tcp:502: Request processed in 272us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574095.589625:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:3.0:1788574095.594965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574095.595076:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634432 00000100:00100000:0.0:1788574095.595088:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634432 00000100:00100000:0.0:1788574095.595786:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:0.0:1788574095.595795:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875455727634432:12345-192.168.201.57@tcp:38: 00010000:00080000:0.0:1788574095.595822:0:5858:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1788574095.595867:0:5858:0:(genops.c:1385:class_connect()) connect: client f540d78c-33c0-4206-a4f5-51879daa7a3f, cookie 0x10531a153b5358af 00000004:00100000:0.0:1788574095.595892:0:5858:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788574095.595911:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788574095.625312:0:5858:0:(import.c:65:import_set_state_nolock()) ffff90a7a7739800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574095.625415:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2352:x1875455727634432:12345-192.168.201.57@tcp:38: Request processed in 29617us (30459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.625427:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00010000:00010000:1.0:1788574095.682267:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574096.004113:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574096.004141:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747579520:0@lo:13: 00000100:00100000:0.0:1788574096.004215:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574096.004903:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579520 00000100:00100000:2.0:1788574096.004913:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579520 00000100:00100000:2.0:1788574096.004985:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574096.004995:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747579520:12345-0@lo:13: 00002000:00000024:2.0:1788574096.005030:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574096.005097:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747579520:12345-0@lo:13: Request processed in 92us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.005104:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788574096.005148:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a792459c00 x1875455747579520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574096.005166:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747579520:0@lo:13: 00000100:00100000:0.0:1788574096.636087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574096.636145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574096.636294:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634560 00000100:00100000:2.0:1788574096.636306:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634560 00000100:00100000:2.0:1788574096.636416:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634688 00000100:00100000:2.0:1788574096.636420:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634688 00000100:00100000:2.0:1788574096.636440:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574096.636451:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:0:x1875455727634560:12345-192.168.201.57@tcp:41: 00000004:00000024:2.0:1788574096.636505:0:5859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788574096.636607:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:0:x1875455727634560:12345-192.168.201.57@tcp:41: Request processed in 157us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.636614:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574096.636632:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574096.636638:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5581:x1875455727634688:12345-192.168.201.57@tcp:41: 00000004:00000024:2.0:1788574096.636649:0:5859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788574096.636672:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5581:x1875455727634688:12345-192.168.201.57@tcp:41: Request processed in 34us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.636678:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00080000:0.0:1788574096.637009:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574096.641317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574096.641586:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634816 00000100:00100000:2.0:1788574096.641610:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634816 00000100:00100000:2.0:1788574096.641672:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574096.641683:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5581:x1875455727634816:12345-192.168.201.57@tcp:40: 00000100:00100000:2.0:1788574096.641776:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5581:x1875455727634816:12345-192.168.201.57@tcp:40: Request processed in 94us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.641784:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574096.647521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574096.647581:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574096.647614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574096.647653:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574096.647814:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727634944 00000100:00100000:2.0:1788574096.647825:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727634944 00000100:00100000:2.0:1788574096.647879:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635072 00000100:00100000:2.0:1788574096.647883:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635072 00000100:00100000:2.0:1788574096.647898:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574096.647908:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875455727634944:12345-192.168.201.57@tcp:8: 00010000:00080000:2.0:1788574096.647940:0:6713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1788574096.647976:0:6713:0:(genops.c:1385:class_connect()) connect: client f540d78c-33c0-4206-a4f5-51879daa7a3f, cookie 0x10531a153b5358b6 00002000:00100000:2.0:1788574096.647989:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f540d78c-33c0-4206-a4f5-51879daa7a3f/ffff90a78f4fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574096.648015:0:6713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574096.648404:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574096.648692:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a78f4fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574096.648760:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2352:x1875455727634944:12345-192.168.201.57@tcp:8: Request processed in 851us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.648768:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574096.648790:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574096.648796:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875455727635072:12345-192.168.201.57@tcp:8: 00010000:00080000:2.0:1788574096.648814:0:6713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1788574096.648829:0:6713:0:(genops.c:1385:class_connect()) connect: client f540d78c-33c0-4206-a4f5-51879daa7a3f, cookie 0x10531a153b5358bd 00002000:00100000:2.0:1788574096.648850:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f540d78c-33c0-4206-a4f5-51879daa7a3f/ffff90a78f4fd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574096.648859:0:6713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574096.649284:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788574096.649304:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a78f4fa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574096.649330:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2352:x1875455727635072:12345-192.168.201.57@tcp:8: Request processed in 532us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.649337:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574096.649395:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635328 00000100:00100000:2.0:1788574096.649402:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635328 00000100:00100000:2.0:1788574096.649513:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 127 00000100:00100000:2.0:1788574096.649520:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:2354:x1875455727635328:12345-192.168.201.57@tcp:400: 00000100:00100000:2.0:1788574096.649592:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:2354:x1875455727635328:12345-192.168.201.57@tcp:400: Request processed in 72us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.649599:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 127 00000100:00100000:1.0:1788574096.649763:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635200 00000100:00100000:1.0:1788574096.649770:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635200 00000100:00100000:1.0:1788574096.649815:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788574096.649824:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5581:x1875455727635200:12345-192.168.201.57@tcp:33: 00000004:00080000:3.0:1788574096.692753:0:5860:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42855us 00000004:00200000:1.0:1788574096.705811:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788574096.705945:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5581:x1875455727635200:12345-192.168.201.57@tcp:33: Request processed in 56115us (58357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574096.705957:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00010000:00010000:3.0:1788574096.707385:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574096.914648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574096.915177:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635456 00000100:00100000:2.0:1788574096.915189:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635456 00000100:00100000:2.0:1788574096.915258:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574096.915269:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5621:x1875455727635456:12345-192.168.201.57@tcp:101: 00010000:00010000:2.0:1788574096.915290:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574096.915365:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984400/0x10531a153b5358c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce36cc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574096.915810:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b5358cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574096.915837:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b5358cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574096.915851:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b5358cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574096.915897:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574096.915901:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574096.915917:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b5358cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574096.915941:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984400/0x10531a153b5358c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36cc expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574096.915959:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b5358cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36cc expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574096.915967:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574096.915970:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574096.915973:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a800, rc 0) 00000100:00100000:3.0:1788574096.916040:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:5621:x1875455727635456:12345-192.168.201.57@tcp:101: Request processed in 773us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574096.916047:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:3.0:1788574097.733280:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574098.560678:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574098.560718:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747579648:0@lo:13: 00000100:00100000:1.0:1788574098.560802:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574098.560933:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579648 00000100:00100000:2.0:1788574098.560941:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579648 00000100:00100000:2.0:1788574098.561008:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574098.561017:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747579648:12345-0@lo:13: 00002000:00000024:2.0:1788574098.561065:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574098.561111:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747579648:12345-0@lo:13: Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574098.561119:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788574098.561232:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574098.561262:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8ec380 x1875455747579648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574098.561280:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747579648:0@lo:13: 00010000:00010000:1.0:1788574098.759327:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574099.372681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574099.372938:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635584 00000100:00100000:0.0:1788574099.372951:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635584 00000100:00080000:1.0:1788574099.373126:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574099.373201:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788574099.373217:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:5674:x1875455727635584:12345-192.168.201.57@tcp:41: 00000004:00000024:0.0:1788574099.373266:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788574099.373346:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:5674:x1875455727635584:12345-192.168.201.57@tcp:41: Request processed in 133us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574099.377149:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788574099.378206:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574099.378307:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635712 00000100:00100000:2.0:1788574099.378318:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635712 00000100:00080000:1.0:1788574099.378463:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574099.378614:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574099.378627:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5674:x1875455727635712:12345-192.168.201.57@tcp:13: 00002000:00000024:2.0:1788574099.378658:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574099.378728:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5674:x1875455727635712:12345-192.168.201.57@tcp:13: Request processed in 103us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574099.378735:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788574099.381439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574099.381712:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635840 00000100:00100000:2.0:1788574099.381723:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635840 00000100:00100000:2.0:1788574099.381840:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574099.381852:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5674:x1875455727635840:12345-192.168.201.57@tcp:13: 00002000:00000024:2.0:1788574099.381898:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574099.381978:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:5674:x1875455727635840:12345-192.168.201.57@tcp:13: Request processed in 128us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574099.381984:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00080000:1.0:1788574099.382048:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788574099.777171:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574100.609607:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747580160:0@lo:400: 00000100:00100000:1.0:1788574100.609684:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574100.609736:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788574100.609742:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747579776:0@lo:400: 00000100:00100000:1.0:1788574100.609769:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574100.609789:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747580288:0@lo:400: 00000100:00100000:1.0:1788574100.609812:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574100.609842:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580288 00000100:00100000:1.0:1788574100.609849:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580288 00000100:00100000:1.0:1788574100.609904:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574100.609914:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747580288:12345-0@lo:400: 00000100:00100000:1.0:1788574100.609964:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747580288:12345-0@lo:400: Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574100.609970:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574100.609985:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579776 00000100:00100000:0.0:1788574100.609990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579776 00000100:00080000:1.0:1788574100.609999:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574100.610015:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788574100.610022:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747579776:12345-0@lo:400: 00000100:00100000:0.0:1788574100.610057:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747579776:12345-0@lo:400: Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574100.610063:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788574100.610201:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747579904:0@lo:400: 00000100:00100000:2.0:1788574100.610234:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574100.610256:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747580416:0@lo:400: 00000100:00100000:2.0:1788574100.610277:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574100.610296:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574100.610301:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747580032:0@lo:400: 00000100:00100000:2.0:1788574100.610332:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574100.610363:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580160 00000100:00100000:2.0:1788574100.610381:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580160 00000100:00100000:2.0:1788574100.610418:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580416 00000100:00100000:2.0:1788574100.610422:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580416 00000100:00100000:2.0:1788574100.610439:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574100.610446:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747580160:12345-0@lo:400: 00000100:00100000:2.0:1788574100.610492:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747580160:12345-0@lo:400: Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574100.610499:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574100.610516:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574100.610522:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747580416:12345-0@lo:400: 00000100:00100000:2.0:1788574100.610553:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747580416:12345-0@lo:400: Request processed in 32us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574100.610559:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574100.610581:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747579904 00000100:00100000:2.0:1788574100.610585:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747579904 00000100:00100000:2.0:1788574100.610607:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580032 00000100:00100000:2.0:1788574100.610616:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580032 00000100:00100000:2.0:1788574100.610631:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574100.610637:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747579904:12345-0@lo:400: 00000100:00100000:2.0:1788574100.610668:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747579904:12345-0@lo:400: Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574100.610674:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574100.610685:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574100.610691:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747580032:12345-0@lo:400: 00000100:00100000:2.0:1788574100.610716:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747580032:12345-0@lo:400: Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574100.610728:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788574100.610755:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574100.610759:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574100.610761:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574100.610791:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747580032:0@lo:400: 00000100:00100000:2.0:1788574100.610802:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747579904:0@lo:400: 00010000:00080000:2.0:1788574100.610813:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05180 x1875455747580416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574100.610823:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747580416:0@lo:400: 00000100:00100000:1.0:1788574100.611256:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747580288:0@lo:400: 00010000:00080000:1.0:1788574100.611278:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05880 x1875455747580160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574100.611287:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747580160:0@lo:400: 00000100:00100000:1.0:1788574100.611306:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747579776:0@lo:400: 00000001:00100000:0.0:1788574100.745710:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00010000:00010000:2.0:1788574100.802701:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574101.129082:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747580544:0@lo:13: 00000100:00100000:0.0:1788574101.129176:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574101.129275:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580544 00000100:00100000:0.0:1788574101.129283:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580544 00000100:00100000:0.0:1788574101.129329:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574101.129338:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747580544:12345-0@lo:13: 00002000:00000024:0.0:1788574101.129409:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574101.129467:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747580544:12345-0@lo:13: Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574101.129485:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788574101.129531:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79245aa00 x1875455747580544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574101.129549:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747580544:0@lo:13: 00000001:00100000:0.0:1788574101.220740:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000001:00100000:3.0:1788574101.696308:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000100:00100000:1.0:1788574101.817281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574101.817324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574101.817359:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574101.817435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574101.817544:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727635968 00000100:00100000:2.0:1788574101.817556:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727635968 00000100:00100000:2.0:1788574101.817617:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:2.0:1788574101.817635:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727635968:12345-192.168.201.57@tcp:400: 00000100:00100000:2.0:1788574101.817715:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727635968:12345-192.168.201.57@tcp:400: Request processed in 82us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574101.817724:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:2.0:1788574101.817760:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636352 00000100:00100000:2.0:1788574101.817764:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636352 00000100:00100000:2.0:1788574101.817811:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636224 00000100:00100000:2.0:1788574101.817814:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636224 00000100:00100000:2.0:1788574101.817832:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574101.817839:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727636352:12345-192.168.201.57@tcp:400: 00000100:00100000:2.0:1788574101.817867:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727636352:12345-192.168.201.57@tcp:400: Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574101.817890:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574101.817904:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574101.817910:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727636224:12345-192.168.201.57@tcp:400: 00000100:00100000:2.0:1788574101.817935:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727636224:12345-192.168.201.57@tcp:400: Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574101.817941:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:2.0:1788574101.818446:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574101.818451:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574101.820659:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636096 00000100:00100000:0.0:1788574101.820688:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636096 00000100:00100000:1.0:1788574101.820961:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788574101.820975:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727636096:12345-192.168.201.57@tcp:400: 00000100:00100000:1.0:1788574101.821086:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727636096:12345-192.168.201.57@tcp:400: Request processed in 115us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574101.821095:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00080000:2.0:1788574101.821891:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574101.825172:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574102.709494:0:8327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788574102.862574:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574103.681562:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574103.681589:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747580672:0@lo:13: 00000100:00100000:1.0:1788574103.681666:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574103.681743:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580672 00000100:00100000:1.0:1788574103.681752:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580672 00000100:00100000:1.0:1788574103.681809:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574103.681818:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747580672:12345-0@lo:13: 00002000:00000024:1.0:1788574103.681852:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574103.681901:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747580672:12345-0@lo:13: Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574103.681916:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788574103.681942:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574103.681974:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d07100 x1875455747580672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574103.681992:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747580672:0@lo:13: 00010000:00010000:2.0:1788574103.877857:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574104.900543:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574105.732573:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747580800:0@lo:400: 00000100:00100000:1.0:1788574105.732657:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574105.732704:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747581312:0@lo:400: 00000100:00100000:1.0:1788574105.732741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574105.732765:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574105.732771:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747581184:0@lo:400: 00000100:00100000:1.0:1788574105.732793:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574105.732828:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580800 00000100:00100000:1.0:1788574105.732836:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580800 00000100:00100000:1.0:1788574105.732887:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788574105.732896:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747580800:12345-0@lo:400: 00000100:00100000:1.0:1788574105.732951:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747580800:12345-0@lo:400: Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574105.732959:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788574105.732996:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747581312 00000100:00100000:1.0:1788574105.733000:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747581312 00000100:00100000:1.0:1788574105.733034:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574105.733040:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747581312:12345-0@lo:400: 00000100:00100000:1.0:1788574105.733070:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747581312:12345-0@lo:400: Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574105.733090:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574105.733108:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747581184 00000100:00100000:1.0:1788574105.733113:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747581184 00000100:00100000:1.0:1788574105.733138:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574105.733145:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747581184:12345-0@lo:400: 00000100:00100000:1.0:1788574105.733191:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747581184:12345-0@lo:400: Request processed in 47us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574105.733199:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788574105.733220:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574105.733226:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788574105.733263:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d07480 x1875455747581184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574105.733280:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747581184:0@lo:400: 00000100:00100000:1.0:1788574105.733290:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747580800:0@lo:400: 00000100:00100000:1.0:1788574105.733300:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747581312:0@lo:400: 00000100:00100000:0.0:1788574105.733710:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747580928:0@lo:400: 00000100:00100000:0.0:1788574105.733756:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574105.733776:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747581440:0@lo:400: 00000100:00100000:0.0:1788574105.733794:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574105.733815:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574105.733820:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747581056:0@lo:400: 00000100:00100000:0.0:1788574105.733840:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574105.733871:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747580928 00000100:00100000:0.0:1788574105.733885:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747580928 00000100:00100000:0.0:1788574105.733913:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747581056 00000100:00100000:0.0:1788574105.733916:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747581056 00000100:00100000:0.0:1788574105.733938:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574105.733944:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747580928:12345-0@lo:400: 00000100:00100000:0.0:1788574105.733983:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747580928:12345-0@lo:400: Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574105.733989:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574105.734004:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574105.734010:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747581056:12345-0@lo:400: 00000100:00100000:0.0:1788574105.734035:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747581056:12345-0@lo:400: Request processed in 25us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574105.734039:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574105.734055:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747581440 00000100:00100000:0.0:1788574105.734058:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747581440 00000100:00100000:0.0:1788574105.734081:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574105.734088:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747581440:12345-0@lo:400: 00000100:00100000:0.0:1788574105.734114:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747581440:12345-0@lo:400: Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574105.734120:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574105.734146:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747581056:0@lo:400: 00000100:00100000:0.0:1788574105.734155:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747580928:0@lo:400: 00010000:00080000:0.0:1788574105.734165:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d04e00 x1875455747581440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574105.734173:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747581440:0@lo:400: 00000100:00080000:0.0:1788574105.734198:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574105.734208:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574105.920863:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574106.240596:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574106.240631:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747581568:0@lo:13: 00000100:00100000:3.0:1788574106.240712:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574106.240892:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747581568 00000100:00100000:0.0:1788574106.240901:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747581568 00000100:00100000:0.0:1788574106.240965:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574106.240977:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747581568:12345-0@lo:13: 00002000:00000024:0.0:1788574106.241013:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574106.241057:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747581568:12345-0@lo:13: Request processed in 83us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574106.241064:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788574106.241213:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79245bb80 x1875455747581568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574106.241230:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747581568:0@lo:13: 00000100:00100000:1.0:1788574106.926144:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574106.926224:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574106.926332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636480 00000100:00100000:0.0:1788574106.926344:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636480 00000100:00100000:1.0:1788574106.926359:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574106.926440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574106.926458:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 131 00000100:00100000:0.0:1788574106.926469:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2354:x1875455727636480:12345-192.168.201.57@tcp:400: 00000100:00100000:1.0:1788574106.926471:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636736 00000100:00100000:1.0:1788574106.926475:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636736 00000100:00100000:1.0:1788574106.926512:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636864 00000100:00100000:1.0:1788574106.926515:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636864 00000100:00100000:1.0:1788574106.926531:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574106.926537:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727636736:12345-192.168.201.57@tcp:400: 00000100:00100000:0.0:1788574106.926551:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2354:x1875455727636480:12345-192.168.201.57@tcp:400: Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574106.926558:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 131 00000100:00100000:1.0:1788574106.926564:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727636736:12345-192.168.201.57@tcp:400: Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574106.926584:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574106.926596:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574106.926602:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727636864:12345-192.168.201.57@tcp:400: 00000100:00100000:1.0:1788574106.926624:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727636864:12345-192.168.201.57@tcp:400: Request processed in 23us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574106.926630:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00080000:1.0:1788574106.926644:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574106.926648:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574106.927227:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636608 00000100:00100000:3.0:1788574106.927234:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636608 00000100:00100000:3.0:1788574106.927333:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:3.0:1788574106.927342:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727636608:12345-192.168.201.57@tcp:400: 00000100:00100000:3.0:1788574106.927426:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727636608:12345-192.168.201.57@tcp:400: Request processed in 85us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574106.927433:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00080000:1.0:1788574106.927796:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574106.944777:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574107.287861:0:8476:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff80d6e5e0 20000000:00000080:0.0:1788574107.287879:0:8476:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7a7515400 uarg=0000000000000000 20000000:01000000:0.0:1788574107.287918:0:8476:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788574107.287920:0:8476:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788574107.287923:0:8476:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788574107.287927:0:8476:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788574107.287932:0:8476:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788574107.287945:0:8476:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788574107.287947:0:8476:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788574107.290844:0:8476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788574107.290852:0:8476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574107.300002:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788574107.300636:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788574107.300737:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788574107.300779:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788574107.300794:0:8476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788574107.300797:0:8476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788574107.302558:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788574107.314320:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788574107.314421:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788574107.314483:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788574107.314505:0:8476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788574107.314508:0:8476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788574107.320539:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788574107.321216:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788574107.321285:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788574107.321328:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788574107.321343:0:8476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788574107.321346:0:8476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574107.323631:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788574107.324204:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788574107.324274:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788574107.324312:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1788574107.324334:0:8476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788574107.324354:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324420:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357c8 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324428:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357f2 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324435:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53581c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324441:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53582a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324448:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535838 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324455:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535854 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324462:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53587e expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324483:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324490:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324498:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324540:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324556:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 9 pid: 5852 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.324571:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747581696:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574107.324691:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324700:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 9 pid: 5851 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.324709:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747581824:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574107.324742:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53587e expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324751:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53587e expref: 18 pid: 5851 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.324774:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747581952:0@lo:104: 00000100:00100000:0.0:1788574107.324834:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574107.324875:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535854 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.324884:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535854 expref: 18 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.324892:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582080:0@lo:104: 00000100:00100000:0.0:1788574107.324916:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.324955:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788574107.324967:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747581952 00000100:00100000:0.0:1788574107.324974:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747581952 00000100:00100000:0.0:1788574107.325007:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582080 00000100:00100000:0.0:1788574107.325010:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582080 00000100:00100000:0.0:1788574107.325023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574107.325031:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:8476:x1875455747581952:12345-0@lo:104: 00010000:00010000:0.0:1788574107.325044:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325105:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574107.325113:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:8476:x1875455747581952:12345-0@lo:104: Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.325120:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574107.325138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574107.325145:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e975050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582080:12345-0@lo:104: 00010000:00010000:0.0:1788574107.325153:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325193:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788574107.325199:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e975050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582080:12345-0@lo:104: Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.325205:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788574107.325244:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574107.325250:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325258:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574107.325262:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325270:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574107.325276:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574107.325282:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574107.325307:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325314:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574107.325330:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325337:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165b600/0x10531a153b53587e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535885 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325360:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574107.325395:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325401:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574107.325404:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325412:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574107.325418:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574107.325423:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574107.325438:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325444:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574107.325450:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325456:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165a000/0x10531a153b535854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53585b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325467:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.325468:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.325470:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574107.325484:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747582208:0@lo:103: 00000100:00100000:0.0:1788574107.325522:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.325547:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574107.325553:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747582336:0@lo:103: 00000100:00100000:0.0:1788574107.325584:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.325610:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582208 00000100:00100000:0.0:1788574107.325614:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582208 00010000:00010000:0.0:1788574107.325632:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53587e expref: 19 pid: 5851 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.325650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582336 00000100:00100000:0.0:1788574107.325652:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582336 00010000:00010000:0.0:1788574107.325661:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535854 expref: 20 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.325672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574107.325678:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+20:3312:x1875455747582208:12345-0@lo:103: 00010000:00010000:0.0:1788574107.325687:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574107.325692:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53587e expref: 20 pid: 5851 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325701:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53587e expref: 20 pid: 5851 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325717:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574107.325743:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+20:3312:x1875455747582208:12345-0@lo:103: Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.325749:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574107.325761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574107.325766:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747582336:12345-0@lo:103: 00010000:00010000:0.0:1788574107.325782:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574107.325786:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535854 expref: 19 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325794:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535854 expref: 19 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325803:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574107.325824:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747582336:12345-0@lo:103: Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.325829:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574107.325866:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747582336:0@lo:103: 00000100:00100000:0.0:1788574107.325876:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747582208:0@lo:103: 00010000:00010000:0.0:1788574107.325911:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535838 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.325920:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535838 expref: 18 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.325929:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582464:0@lo:104: 00000100:00100000:0.0:1788574107.325951:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.325971:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582464 00000100:00100000:0.0:1788574107.325975:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582464 00000100:00100000:0.0:1788574107.325994:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574107.326000:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582464:12345-0@lo:104: 00010000:00010000:0.0:1788574107.326008:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326048:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574107.326053:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582464:12345-0@lo:104: Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.326059:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788574107.326072:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574107.326077:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326084:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574107.326087:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326095:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574107.326101:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574107.326106:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574107.326120:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326126:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574107.326141:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326147:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b535838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53583f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326174:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.326176:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.326177:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574107.326188:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747582592:0@lo:103: 00000100:00100000:0.0:1788574107.326210:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.326233:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582592 00000100:00100000:0.0:1788574107.326237:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582592 00010000:00010000:0.0:1788574107.326249:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535838 expref: 19 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.326267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574107.326273:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747582592:12345-0@lo:103: 00010000:00010000:0.0:1788574107.326280:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574107.326285:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535838 expref: 19 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326292:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535838 expref: 19 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326301:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574107.326325:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747582592:12345-0@lo:103: Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.326331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574107.326356:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747582592:0@lo:103: 00010000:00010000:0.0:1788574107.326438:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53582a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326455:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53582a expref: 18 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.326464:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582720:0@lo:104: 00000100:00100000:0.0:1788574107.326485:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.326517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582720 00000100:00100000:0.0:1788574107.326521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582720 00000100:00100000:0.0:1788574107.326539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574107.326544:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582720:12345-0@lo:104: 00010000:00010000:0.0:1788574107.326552:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326584:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574107.326588:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582720:12345-0@lo:104: Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.326594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788574107.326608:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574107.326612:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326619:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574107.326622:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326629:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574107.326635:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574107.326647:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574107.326663:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326669:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574107.326679:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326685:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d800/0x10531a153b53582a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535831 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326695:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.326696:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.326698:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574107.326703:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574107.326710:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747582848:0@lo:103: 00000100:00100000:0.0:1788574107.326733:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.326754:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582848 00000100:00100000:0.0:1788574107.326758:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582848 00010000:00010000:0.0:1788574107.326772:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53582a expref: 19 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.326791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574107.326797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747582848:12345-0@lo:103: 00010000:00010000:0.0:1788574107.326805:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574107.326809:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53582a expref: 19 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326817:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53582a expref: 19 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326836:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574107.326864:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747582848:12345-0@lo:103: Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.326871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574107.326896:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747582848:0@lo:103: 00010000:00010000:0.0:1788574107.326924:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53581c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.326933:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53581c expref: 18 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.326941:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582976:0@lo:104: 00000100:00100000:0.0:1788574107.326963:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.326981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747582976 00000100:00100000:0.0:1788574107.326985:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747582976 00000100:00100000:0.0:1788574107.327001:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574107.327007:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582976:12345-0@lo:104: 00010000:00010000:0.0:1788574107.327014:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327044:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574107.327049:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747582976:12345-0@lo:104: Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.327055:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788574107.327067:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574107.327071:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327087:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2158200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574107.327090:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327096:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574107.327102:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574107.327106:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574107.327120:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327126:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574107.327136:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327142:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2158200/0x10531a153b53581c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535823 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327153:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.327155:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.327156:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574107.327165:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747583104:0@lo:103: 00000100:00100000:0.0:1788574107.327190:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574107.327214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583104 00000100:00100000:0.0:1788574107.327217:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583104 00010000:00010000:0.0:1788574107.327231:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53581c expref: 19 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574107.327255:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574107.327261:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747583104:12345-0@lo:103: 00010000:00010000:0.0:1788574107.327269:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574107.327273:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53581c expref: 19 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327280:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53581c expref: 19 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.327290:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574107.327315:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747583104:12345-0@lo:103: Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.327321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574107.327343:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747583104:0@lo:103: 00010000:00010000:1.0:1788574107.330219:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574107.333901:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574107.333943:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574107.333973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727636992 00000100:00100000:2.0:1788574107.333982:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727636992 00010000:00010000:2.0:1788574107.334020:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 10 pid: 5852 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574107.334049:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637120 00000100:00100000:2.0:1788574107.334052:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637120 00010000:00010000:2.0:1788574107.334079:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 11 pid: 5851 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.334229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574107.334241:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec16a69b-cbad-484e-9f31-b00eca338977+11:2356:x1875455727636992:12345-192.168.201.57@tcp:103: 00010000:00010000:3.0:1788574107.334256:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574107.334262:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 11 pid: 5852 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574107.334276:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 11 pid: 5852 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574107.334296:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574107.334349:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec16a69b-cbad-484e-9f31-b00eca338977+11:2356:x1875455727636992:12345-192.168.201.57@tcp:103: Request processed in 110us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574107.334357:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574107.339831:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788574107.339860:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79260b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727637120:12345-192.168.201.57@tcp:103: 00010000:00010000:3.0:1788574107.339880:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574107.339889:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 10 pid: 5851 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574107.339917:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 10 pid: 5851 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574107.339942:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574107.340006:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79260b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727637120:12345-192.168.201.57@tcp:103: Request processed in 160us (6061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574107.340014:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00010000:00010000:2.0:1788574107.343866:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5357f2 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574107.343895:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5357f2 expref: 18 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574107.343917:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747583232:0@lo:104: 00000100:00100000:2.0:1788574107.343992:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574107.344882:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5357c8 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574107.344897:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5357c8 expref: 18 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.344909:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747583360:0@lo:104: 00000100:00100000:3.0:1788574107.344947:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574107.346965:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788574107.347018:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21600/0x10531a153b53589a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3671 expref: 9 pid: 5852 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347036:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747581696:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574107.347053:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b400/0x10531a153b535893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce366a expref: 8 pid: 5851 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347104:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747581824:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574107.347123:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165aa00/0x10531a153b535885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53587e expref: 18 pid: 5851 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347132:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747581952:0@lo:104: 00010000:00010000:3.0:1788574107.347144:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4d400/0x10531a153b53585b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535854 expref: 17 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347153:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582080:0@lo:104: 00010000:00010000:3.0:1788574107.347165:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e984800/0x10531a153b53583f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535838 expref: 16 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347172:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582464:0@lo:104: 00010000:00010000:3.0:1788574107.347182:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2158400/0x10531a153b535831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53582a expref: 15 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347191:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582720:0@lo:104: 00010000:00010000:3.0:1788574107.347200:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159a00/0x10531a153b535823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53581c expref: 14 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.347212:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747582976:0@lo:104: 00000100:00100000:0.0:1788574107.350972:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583232 00000100:00100000:0.0:1788574107.350995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583232 00000100:00100000:0.0:1788574107.351063:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583360 00000100:00100000:0.0:1788574107.351067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583360 00000100:00100000:0.0:1788574107.351182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574107.351196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:8476:x1875455747583232:12345-0@lo:104: 00010000:00010000:0.0:1788574107.351217:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.351415:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574107.351423:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:8476:x1875455747583232:12345-0@lo:104: Request processed in 231us (7431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.351431:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574107.351475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574107.351481:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747583360:12345-0@lo:104: 00010000:00010000:0.0:1788574107.351491:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.351530:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788574107.351535:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8476:x1875455747583360:12345-0@lo:104: Request processed in 55us (6588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574107.351540:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788574107.351557:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574107.351563:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.351571:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574107.351576:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.351586:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574107.351594:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574107.351600:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574107.351752:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574107.351759:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.351765:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21800 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574107.351768:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.351776:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574107.351782:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574107.351787:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574107.351811:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.351818:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574107.351847:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.351855:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b5357c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357cf expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.351870:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574107.351872:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574107.351874:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574107.351891:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747583488:0@lo:103: 00000100:00100000:1.0:1788574107.351937:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574107.351996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583488 00000100:00100000:1.0:1788574107.352001:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583488 00010000:00010000:1.0:1788574107.352022:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5357c8 expref: 14 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574107.352046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574107.352053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+14:3313:x1875455747583488:12345-0@lo:103: 00010000:00010000:1.0:1788574107.352064:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574107.352069:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5357c8 expref: 14 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.352079:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5357c8 expref: 14 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.352109:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574107.352137:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+14:3313:x1875455747583488:12345-0@lo:103: Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574107.352143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574107.352179:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747583488:0@lo:103: 00010000:00010000:0.0:1788574107.352293:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.352301:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574107.352325:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.352341:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165b800/0x10531a153b5357f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357f9 expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574107.352357:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.352359:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574107.352360:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574107.352490:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747583616:0@lo:103: 00000100:00100000:1.0:1788574107.352520:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574107.354824:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747583232:0@lo:104: 00010000:00010000:3.0:1788574107.354881:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4cc00/0x10531a153b5357cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5357c8 expref: 13 pid: 5849 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574107.354900:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1875455747583360:0@lo:104: 00010000:00010000:3.0:1788574107.354973:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574107.355442:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583616 00000100:00100000:1.0:1788574107.355450:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583616 00010000:00010000:1.0:1788574107.355488:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5357f2 expref: 13 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574107.355525:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574107.355534:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+13:3314:x1875455747583616:12345-0@lo:103: 00010000:00010000:1.0:1788574107.355550:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574107.355556:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5357f2 expref: 13 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355566:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5357f2 expref: 13 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355584:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21000/0x10531a153b5357f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5357f2 expref: 13 pid: 5852 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355597:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355605:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355619:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355627:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355657:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355665:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355672:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574107.355676:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355685:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355706:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.355716:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574107.355791:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+12:3314:x1875455747583616:12345-0@lo:103: Request processed in 258us (3269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574107.355799:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574107.355832:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747583616:0@lo:103: 00010000:00010000:2.0:1788574107.356062:0:8476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574107.356071:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574107.356078:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5358d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574107.970315:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574108.460754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574108.460866:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637248 00000100:00100000:1.0:1788574108.460879:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637248 00000100:00100000:1.0:1788574108.460954:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:1.0:1788574108.460969:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+8:5596:x1875455727637248:12345-192.168.201.57@tcp:101: 00010000:00010000:1.0:1788574108.460993:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574108.461021:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21000/0x10531a153b5358d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce36d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.461072:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21000/0x10531a153b5358d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36d3 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.461086:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21000/0x10531a153b5358d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36d3 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.461097:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21000, rc 0) 00000100:00100000:1.0:1788574108.461175:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727637248:12345-192.168.201.57@tcp:101: Request processed in 210us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.461182:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:2.0:1788574108.480707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574108.480783:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637376 00000100:00100000:0.0:1788574108.480795:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637376 00000100:00100000:0.0:1788574108.480871:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:0.0:1788574108.480882:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727637376:12345-192.168.201.57@tcp:501: 00000100:00100000:0.0:1788574108.481210:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727637376:12345-192.168.201.57@tcp:501: Request processed in 330us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.481218:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:3.0:1788574108.485537:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574108.485661:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637504 00000100:00100000:2.0:1788574108.485672:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637504 00000100:00100000:2.0:1788574108.485733:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:2.0:1788574108.485743:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727637504:12345-192.168.201.57@tcp:503: 00000100:00100000:2.0:1788574108.486018:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727637504:12345-192.168.201.57@tcp:503: Request processed in 275us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.486027:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:2.0:1788574108.497613:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574108.498118:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637632 00000100:00100000:3.0:1788574108.498129:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637632 00000100:00100000:3.0:1788574108.498199:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00100000:3.0:1788574108.498210:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+9:6062:x1875455727637632:12345-192.168.201.57@tcp:502: 00000100:00100000:3.0:1788574108.498560:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+9:6062:x1875455727637632:12345-192.168.201.57@tcp:502: Request processed in 351us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574108.498568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00100000:1.0:1788574108.504998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574108.505426:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637760 00000100:00100000:2.0:1788574108.505437:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637760 00000100:00100000:2.0:1788574108.505551:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 136 00000100:00100000:2.0:1788574108.505565:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+9:6062:x1875455727637760:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574108.505928:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+9:6062:x1875455727637760:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 364us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.505936:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 136 00000100:00100000:2.0:1788574108.515103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574108.515332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727637888 00000100:00100000:0.0:1788574108.515353:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727637888 00000100:00100000:0.0:1788574108.515434:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 137 00000100:00100000:0.0:1788574108.515445:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727637888:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574108.515465:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574108.515487:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5358e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce36da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.515522:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5358e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36da expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.515535:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5358e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36da expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.515571:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c600, rc 0) 00000100:00100000:0.0:1788574108.515659:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727637888:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 215us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.515666:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 137 00000100:00100000:0.0:1788574108.530430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574108.532061:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638016 00000100:00100000:2.0:1788574108.532076:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638016 00000100:00100000:2.0:1788574108.532149:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 138 00000100:00100000:2.0:1788574108.532160:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638016:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.532524:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638016:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 364us (2103us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574108.532533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 138 10000000:01000000:3.0:1788574108.673744:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788574108.673753:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6812f6000 from 39 10000000:01000000:3.0:1788574108.673758:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574108.673805:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.673816:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.673828:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574108.673851:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747583744:0@lo:101: 00000100:00100000:3.0:1788574108.673933:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574108.673992:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574108.674120:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583744 00000100:00100000:1.0:1788574108.674129:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583744 00000100:00100000:1.0:1788574108.674182:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788574108.674191:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+12:5854:x1875455747583744:12345-0@lo:101: 00010000:00010000:1.0:1788574108.674203:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574108.674215:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21a00/0x10531a153b5358ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5358e7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.674235:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21a00/0x10531a153b5358ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5358e7 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.674245:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21a00/0x10531a153b5358ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5358e7 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.674253:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21a00, rc 0) 00000100:00100000:1.0:1788574108.674295:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747583744:12345-0@lo:101: Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.674314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788574108.675107:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747583744:0@lo:101: 00010000:00010000:3.0:1788574108.675125:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.675155:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574108.675219:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747583872:0@lo:501: 00000100:00100000:3.0:1788574108.675256:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574108.675291:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.675364:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747583872 00000100:00100000:0.0:1788574108.675390:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747583872 00000100:00100000:0.0:1788574108.675428:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788574108.675437:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747583872:12345-0@lo:501: 00000100:00100000:0.0:1788574108.675711:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747583872:12345-0@lo:501: Request processed in 275us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.675719:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788574108.675840:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747583872:0@lo:501: 00000100:00100000:3.0:1788574108.675869:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584000:0@lo:503: 00000100:00100000:3.0:1788574108.675921:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574108.675952:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.676082:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584000 00000100:00100000:2.0:1788574108.676087:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584000 00000100:00100000:2.0:1788574108.676126:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788574108.676135:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747584000:12345-0@lo:503: 00000100:00100000:2.0:1788574108.676306:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747584000:12345-0@lo:503: Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.676314:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788574108.678357:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584000:0@lo:503: 00000100:00100000:3.0:1788574108.681275:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8492:1875455747584128:0@lo:502: 00000100:00100000:3.0:1788574108.681462:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574108.681514:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79236a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574108.681654:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584128 00000100:00100000:1.0:1788574108.681667:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584128 00000100:00100000:1.0:1788574108.681738:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788574108.681750:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:8492:x1875455747584128:12345-0@lo:502: 00000100:00100000:1.0:1788574108.682289:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:8492:x1875455747584128:12345-0@lo:502: Request processed in 540us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.682297:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788574108.682583:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8492:1875455747584128:0@lo:502: 00000100:00100000:3.0:1788574108.682661:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8492:1875455747584256:0@lo:502: 00000100:00100000:3.0:1788574108.682702:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574108.682742:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.683035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584256 00000100:00100000:0.0:1788574108.683041:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584256 00000100:00100000:0.0:1788574108.683082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788574108.683090:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:8492:x1875455747584256:12345-0@lo:502: 00000100:00100000:0.0:1788574108.683290:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+13:8492:x1875455747584256:12345-0@lo:502: Request processed in 200us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.683297:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788574108.683603:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8492:1875455747584256:0@lo:502: 00000040:00080000:3.0:1788574108.683628:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788574108.690037:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788574108.690084:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574108.690099:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.690112:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574108.690165:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788574108.690169:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788574108.690172:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788574108.690215:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.690224:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.690234:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.690260:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584384:0@lo:101: 00000100:00100000:0.0:1788574108.690324:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.690416:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574108.690823:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584384 00000100:00100000:1.0:1788574108.690830:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584384 00000100:00100000:1.0:1788574108.690882:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788574108.690893:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+13:5854:x1875455747584384:12345-0@lo:101: 00010000:00010000:1.0:1788574108.690905:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574108.690918:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21800/0x10531a153b5358fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5358f5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.690938:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21800/0x10531a153b5358fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5358f5 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.690948:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21800/0x10531a153b5358fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5358f5 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.690956:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21800, rc 0) 00000100:00100000:1.0:1788574108.690994:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747584384:12345-0@lo:101: Request processed in 103us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.691000:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788574108.692622:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584384:0@lo:101: 00010000:00010000:0.0:1788574108.692647:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.692659:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.692738:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584512:0@lo:501: 00000100:00100000:0.0:1788574108.692788:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.692818:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574108.693949:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584512 00000100:00100000:1.0:1788574108.693960:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584512 00000100:00100000:1.0:1788574108.694044:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788574108.694055:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747584512:12345-0@lo:501: 00000100:00100000:1.0:1788574108.695926:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747584512:12345-0@lo:501: Request processed in 1866us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.695939:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788574108.709235:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584512:0@lo:501: 00000100:00100000:3.0:1788574108.709309:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584640:0@lo:503: 00000100:00100000:3.0:1788574108.709445:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574108.709480:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.709572:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584640 00000100:00100000:0.0:1788574108.709580:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584640 00000100:00100000:0.0:1788574108.709634:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788574108.709650:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747584640:12345-0@lo:503: 00000100:00100000:0.0:1788574108.709841:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747584640:12345-0@lo:503: Request processed in 192us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.709848:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788574108.709951:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747584640:0@lo:503: 00000100:00100000:1.0:1788574108.710642:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8493:1875455747584768:0@lo:502: 00000100:00100000:1.0:1788574108.710682:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.710714:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.710776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584768 00000100:00100000:2.0:1788574108.710781:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584768 00000100:00100000:2.0:1788574108.710817:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788574108.710826:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:8493:x1875455747584768:12345-0@lo:502: 00000100:00100000:2.0:1788574108.710995:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+14:8493:x1875455747584768:12345-0@lo:502: Request processed in 169us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.711003:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788574108.711190:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8493:1875455747584768:0@lo:502: 00000020:01000000:1.0:1788574108.711215:0:8493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574108.711223:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574108.711225:0:8493:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788574108.711230:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788574108.711250:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8493:1875455747584896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574108.711281:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.711303:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.711364:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747584896 00000100:00100000:0.0:1788574108.711399:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747584896 00000100:00100000:0.0:1788574108.711421:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788574108.711428:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:8493:x1875455747584896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574108.711545:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+14:8493:x1875455747584896:12345-0@lo:502:llog_process_th.0 Request processed in 117us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.711551:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788574108.711626:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8493:1875455747584896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574108.711646:0:8493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574108.711650:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574108.711651:0:8493:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788574108.711655:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788574108.711807:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788574108.711828:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788574108.711837:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.711848:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574108.711860:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788574108.711863:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a785e1b800 from 39 10000000:01000000:0.0:1788574108.711866:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574108.711891:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.711898:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.711907:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.711929:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.711958:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.711991:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a78700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574108.712048:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585024 00000100:00100000:3.0:1788574108.712053:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585024 00000100:00100000:3.0:1788574108.712075:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788574108.712081:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+14:5854:x1875455747585024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574108.712090:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574108.712104:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165b400/0x10531a153b53590a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535903 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.712125:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165b400/0x10531a153b53590a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535903 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.712135:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165b400/0x10531a153b53590a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535903 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.712144:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b400, rc 0) 00000100:00100000:3.0:1788574108.712188:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747585024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574108.712193:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788574108.715138:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574108.715168:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.715205:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574108.715293:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574108.715409:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.715456:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.715705:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585152 00000100:00100000:0.0:1788574108.715712:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585152 00000100:00100000:0.0:1788574108.715763:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788574108.715772:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747585152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.716072:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747585152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.716081:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788574108.716126:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.716164:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.716208:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.716242:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.716299:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585280 00000100:00100000:0.0:1788574108.716303:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585280 00000100:00100000:0.0:1788574108.716332:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788574108.716351:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747585280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.716504:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747585280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.716511:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788574108.716602:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.716997:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8494:1875455747585408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.717048:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.717077:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.717131:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585408 00000100:00100000:0.0:1788574108.717136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585408 00000100:00100000:0.0:1788574108.717177:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788574108.717184:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8494:x1875455747585408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574108.717365:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8494:x1875455747585408:12345-0@lo:502:llog_process_th.0 Request processed in 180us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.717390:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788574108.717723:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8494:1875455747585408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.717768:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8494:1875455747585536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.717803:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.717834:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.717972:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585536 00000100:00100000:0.0:1788574108.717983:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585536 00000100:00100000:0.0:1788574108.718027:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788574108.718034:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8494:x1875455747585536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574108.718182:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:8494:x1875455747585536:12345-0@lo:502:llog_process_th.0 Request processed in 148us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.718189:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788574108.718409:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8494:1875455747585536:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788574108.718430:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788574108.718792:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788574108.718812:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574108.718822:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.718832:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574108.718841:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788574108.718844:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788574108.718846:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574108.718874:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.718881:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.718890:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.718905:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793286680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.718937:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.718968:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.719036:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585664 00000100:00100000:2.0:1788574108.719041:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585664 00000100:00100000:2.0:1788574108.719078:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788574108.719087:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+15:5854:x1875455747585664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574108.719096:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574108.719108:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985800/0x10531a153b535918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535911 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.719137:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985800/0x10531a153b535918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535911 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.719148:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985800/0x10531a153b535918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535911 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.719158:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985800, rc 0) 00000100:00100000:2.0:1788574108.719680:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747585664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 592us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.719686:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788574108.722001:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793286680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574108.722042:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574108.722055:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574108.722152:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574108.722210:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.722253:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574108.722641:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585792 00000100:00100000:3.0:1788574108.722650:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585792 00000100:00100000:3.0:1788574108.722687:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788574108.722695:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747585792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574108.722982:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747585792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574108.722990:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788574108.723428:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574108.723468:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574108.723513:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.723539:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.723597:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747585920 00000100:00100000:2.0:1788574108.723601:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747585920 00000100:00100000:2.0:1788574108.723629:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788574108.723636:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747585920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.723803:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747585920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.723809:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788574108.723960:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747585920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.724689:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8495:1875455747586048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.724735:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.724768:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.724819:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586048 00000100:00100000:0.0:1788574108.724826:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586048 00000100:00100000:0.0:1788574108.724865:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788574108.724874:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+16:8495:x1875455747586048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574108.725075:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+16:8495:x1875455747586048:12345-0@lo:502:llog_process_th.0 Request processed in 203us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.725083:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788574108.725501:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8495:1875455747586048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574108.725533:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574108.725552:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574108.725556:0:8495:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788574108.725562:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788574108.725597:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8495:1875455747586176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574108.725639:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.725666:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574108.725745:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586176 00000100:00100000:3.0:1788574108.725760:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586176 00000100:00100000:3.0:1788574108.725804:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574108.725812:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:8495:x1875455747586176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574108.725978:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:8495:x1875455747586176:12345-0@lo:502:llog_process_th.0 Request processed in 166us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574108.725985:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788574108.726278:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8495:1875455747586176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574108.726300:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574108.726305:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574108.726307:0:8495:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788574108.726311:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788574108.727049:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788574108.727070:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788574108.727083:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.727095:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574108.727105:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788574108.727108:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a790a3d000 from 39 10000000:01000000:0.0:1788574108.727112:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574108.727157:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.727165:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.727174:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.727194:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.727237:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.727289:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574108.736394:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586304 00000100:00100000:3.0:1788574108.736417:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586304 00000100:00100000:3.0:1788574108.736489:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574108.736501:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747586304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574108.736522:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574108.736546:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165ba00/0x10531a153b535926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53591f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.736582:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165ba00/0x10531a153b535926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53591f expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.736595:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165ba00/0x10531a153b535926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53591f expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574108.736604:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165ba00, rc 0) 00000100:00100000:3.0:1788574108.736704:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747586304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (9466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574108.736712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788574108.736866:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574108.736891:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.736902:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.736985:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.737043:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.737089:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574108.737281:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586432 00000100:00100000:1.0:1788574108.737288:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586432 00000100:00100000:1.0:1788574108.737324:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788574108.737332:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747586432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574108.737609:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747586432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.737616:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574108.737747:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.737780:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.737817:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.737846:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574108.737996:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586560 00000100:00100000:3.0:1788574108.738002:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586560 00000100:00100000:3.0:1788574108.741464:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788574108.741493:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747586560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574108.741796:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747586560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 316us (3975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574108.741804:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788574108.741948:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.742166:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8496:1875455747586688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.742213:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.743443:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.743964:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586688 00000100:00100000:0.0:1788574108.743975:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586688 00000100:00100000:0.0:1788574108.744033:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788574108.744042:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:8496:x1875455747586688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574108.744509:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:8496:x1875455747586688:12345-0@lo:502:llog_process_th.0 Request processed in 466us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.744517:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788574108.744721:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8496:1875455747586688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.744813:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8496:1875455747586816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.744855:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.744881:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.744939:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586816 00000100:00100000:0.0:1788574108.744944:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586816 00000100:00100000:0.0:1788574108.744965:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788574108.744971:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:8496:x1875455747586816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574108.745357:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:8496:x1875455747586816:12345-0@lo:502:llog_process_th.0 Request processed in 383us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.745363:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788574108.749870:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8496:1875455747586816:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788574108.749937:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788574108.751295:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788574108.751324:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574108.751356:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.751490:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574108.751502:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788574108.751506:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788574108.751509:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574108.751556:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.751564:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.751575:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574108.751603:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.751673:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.751758:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbeed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574108.753672:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747586944 00000100:00100000:3.0:1788574108.753689:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747586944 00000100:00100000:1.0:1788574108.758533:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788574108.758741:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747586944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574108.758764:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574108.758800:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4c200/0x10531a153b535934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53592d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.758830:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4c200/0x10531a153b535934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53592d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.758841:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4c200/0x10531a153b535934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53592d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574108.758850:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c200, rc 0) 00000100:00100000:0.0:1788574108.758938:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747586944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 391us (7264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.758945:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788574108.759050:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747586944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574108.759070:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.759101:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574108.759186:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.759220:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.759256:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574108.759665:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587072 00000100:00100000:0.0:1788574108.759674:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587072 00000100:00100000:0.0:1788574108.759723:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788574108.759732:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747587072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574108.759996:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747587072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.760005:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788574108.763398:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.763479:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.763562:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.763673:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.763698:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587200 00000100:00100000:2.0:1788574108.763705:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587200 00000100:00100000:2.0:1788574108.763747:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788574108.763756:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747587200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.763949:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747587200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.763963:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788574108.764005:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.764204:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8497:1875455747587328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.764239:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.764259:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587328 00000100:00100000:2.0:1788574108.764263:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587328 00000100:00100000:2.0:1788574108.764281:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788574108.764286:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:8497:x1875455747587328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.764465:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:8497:x1875455747587328:12345-0@lo:502:llog_process_th.0 Request processed in 178us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.764472:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788574108.764498:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.764510:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8497:1875455747587328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574108.764531:0:8497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574108.764540:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574108.764543:0:8497:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788574108.764549:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788574108.764568:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8497:1875455747587456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.764598:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.764617:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587456 00000100:00100000:2.0:1788574108.764620:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587456 00000100:00100000:2.0:1788574108.764637:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788574108.764642:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:8497:x1875455747587456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574108.764750:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:8497:x1875455747587456:12345-0@lo:502:llog_process_th.0 Request processed in 107us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.764766:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788574108.764792:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a787d5bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.764803:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8497:1875455747587456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574108.764820:0:8497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574108.764824:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574108.764826:0:8497:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788574108.764829:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788574108.764872:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788574108.764887:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788574108.764896:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.764907:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574108.764918:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788574108.764920:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a792418000 from 1 10000000:01000000:2.0:1788574108.764923:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788574108.764945:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.764953:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.764962:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574108.764974:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.764999:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.765021:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.765032:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587584 00000100:00100000:2.0:1788574108.765036:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587584 00000100:00100000:2.0:1788574108.765052:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574108.765058:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747587584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574108.765065:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574108.765076:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e984200/0x10531a153b535942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53593b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.765098:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984200/0x10531a153b535942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53593b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.765107:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e984200/0x10531a153b535942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53593b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.765116:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984200, rc 0) 00000100:00100000:2.0:1788574108.765142:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747587584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.765147:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574108.765168:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574108.765179:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.765187:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574108.765226:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.765250:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.765265:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574108.765280:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587712 00000100:00100000:2.0:1788574108.765283:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587712 00000100:00100000:2.0:1788574108.765299:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788574108.765304:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747587712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574108.765541:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747587712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (289us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574108.765549:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788574108.765572:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747587712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788574108.765588:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788574108.765593:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574108.765600:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574108.800629:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747587840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574108.800708:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574108.800831:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747587840 00000100:00100000:0.0:1788574108.800839:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747587840 00000100:00100000:0.0:1788574108.800907:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574108.800917:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747587840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574108.800957:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574108.801008:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747587840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.801015:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788574108.801090:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d06680 x1875455747587840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574108.801109:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747587840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574108.801218:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788574108.992673:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574109.788671:0:8534:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe33197370 20000000:00000080:1.0:1788574109.788696:0:8534:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7a772dc00 uarg=0000000000000000 20000000:01000000:1.0:1788574109.788745:0:8534:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788574109.788753:0:8534:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788574109.788758:0:8534:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788574109.794607:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788574109.799148:0:8534:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788574109.813059:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788574109.813121:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788574109.813473:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788574109.813495:0:8534:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788574109.813516:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813537:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5356b7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813547:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535719 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813554:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5357e4 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813564:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813571:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813616:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813635:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 9 pid: 5849 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.813665:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793286680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747587968:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574109.813777:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5357e4 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.813785:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5357e4 expref: 18 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.813795:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747588096:0@lo:104: 00000100:00100000:0.0:1788574109.813830:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574109.814077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588096 00000100:00100000:2.0:1788574109.814084:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588096 00000100:00100000:2.0:1788574109.814150:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574109.814161:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:8534:x1875455747588096:12345-0@lo:104: 00010000:00010000:2.0:1788574109.814176:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.822568:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574109.822601:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:8534:x1875455747588096:12345-0@lo:104: Request processed in 8436us (8765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574109.822613:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788574109.822650:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574109.822658:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.822667:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574109.822671:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.822682:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574109.822689:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574109.822694:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574109.822736:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.822743:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574109.822763:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.822770:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165a200/0x10531a153b5357e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5357eb expref: -99 pid: 7658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.822783:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574109.822784:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574109.822786:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574109.822812:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747588224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574109.822866:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574109.823364:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535719 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.823400:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535719 expref: 18 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.823412:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747588352:0@lo:104: 00000100:00100000:0.0:1788574109.823442:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574109.823474:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5356b7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.823483:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5356b7 expref: 18 pid: 5851 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.823491:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747588480:0@lo:104: 00000100:00100000:0.0:1788574109.823508:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574109.823531:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747588096:0@lo:104: 00000100:00100000:2.0:1788574109.823736:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788574109.823755:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574109.823778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588352 00000100:00100000:2.0:1788574109.823784:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588352 00000100:00100000:2.0:1788574109.823816:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588480 00000100:00100000:2.0:1788574109.823819:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588480 00000100:00100000:2.0:1788574109.823832:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574109.823840:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7514050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:8534:x1875455747588352:12345-0@lo:104: 00000100:00100000:0.0:1788574109.823986:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588224 00000100:00100000:0.0:1788574109.823999:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588224 00010000:00010000:0.0:1788574109.824019:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5357e4 expref: 19 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.824053:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788574109.824060:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747588224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574109.824073:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574109.824079:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5357e4 expref: 19 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.824088:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5357e4 expref: 19 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.824102:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159c00/0x10531a153b5357eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5357e4 expref: 19 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.824121:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574109.824170:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+18:3312:x1875455747588224:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574109.824177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788574109.824576:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.824639:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574109.824645:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7514050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:8534:x1875455747588352:12345-0@lo:104: Request processed in 806us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574109.824651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574109.824692:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574109.824699:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8534:x1875455747588480:12345-0@lo:104: 00010000:00010000:2.0:1788574109.824708:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.824741:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574109.824745:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:8534:x1875455747588480:12345-0@lo:104: Request processed in 48us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574109.824751:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788574109.824767:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574109.824772:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.824787:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574109.824791:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.824800:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574109.824807:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574109.824812:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574109.824837:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.824844:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574109.824937:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574109.824943:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.824950:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574109.824953:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.824960:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574109.824966:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574109.824971:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574109.824987:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.824992:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574109.825009:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.825016:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159200/0x10531a153b5356b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5356be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.825040:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574109.825042:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574109.825044:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574109.825058:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747588736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574109.825092:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574109.825136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588736 00000100:00100000:3.0:1788574109.825141:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588736 00010000:00010000:3.0:1788574109.825158:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5356b7 expref: 18 pid: 5851 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574109.825178:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574109.825184:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+18:3314:x1875455747588736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574109.825206:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574109.825210:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5356b7 expref: 18 pid: 5851 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.825219:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5356b7 expref: 18 pid: 5851 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.825232:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574109.825260:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+18:3314:x1875455747588736:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574109.825267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574109.825296:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747588736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574109.825478:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.825487:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a20400/0x10531a153b535719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535720 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.825501:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574109.825504:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574109.825505:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574109.825532:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747588224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574109.825543:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574109.825549:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747588608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574109.825572:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574109.825606:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588608 00000100:00100000:2.0:1788574109.825611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588608 00010000:00010000:2.0:1788574109.825626:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535719 expref: 18 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574109.825643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574109.825648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+18:3312:x1875455747588608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574109.825656:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574109.825660:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535719 expref: 18 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.825668:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535719 expref: 18 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.825679:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574109.825706:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+18:3312:x1875455747588608:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574109.825712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574109.825735:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747588608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574109.828555:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159400/0x10531a153b535720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535719 expref: 17 pid: 5852 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.828592:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747588352:0@lo:104: 00010000:00010000:0.0:1788574109.828608:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a780031600/0x10531a153b5356be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5356b7 expref: 16 pid: 5851 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.828619:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747588480:0@lo:104: 00000100:00100000:3.0:1788574109.830945:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574109.831400:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793286680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1875455747587968:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574109.831458:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574109.831737:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638144 00000100:00100000:1.0:1788574109.831745:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638144 00010000:00010000:1.0:1788574109.831785:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 10 pid: 5849 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574109.831834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:1.0:1788574109.831844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727638144:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574109.831872:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574109.831878:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 10 pid: 5849 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831890:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 10 pid: 5849 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985400/0x10531a153b5358a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36a2 expref: 10 pid: 5849 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831922:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831930:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831943:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831950:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831957:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831963:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831979:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574109.831984:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.831991:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.832012:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.832021:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574109.832435:0:8534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.832445:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.832452:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4d000/0x10531a153b535949 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574109.835351:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec16a69b-cbad-484e-9f31-b00eca338977+9:2353:x1875455727638144:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 3492us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.835385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 10000000:01000000:0.0:1788574109.858186:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574109.858197:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6812f6000 from 4 10000000:01000000:0.0:1788574109.858203:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574109.858248:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.858260:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.858271:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574109.858295:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793286680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747588864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574109.858395:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574109.858438:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.858496:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588864 00000100:00100000:1.0:1788574109.858504:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588864 00000100:00100000:1.0:1788574109.858558:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788574109.858567:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747588864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574109.858579:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574109.858592:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535950 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.858614:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535950 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.858624:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535950 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.858633:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21200, rc 0) 00000100:00100000:1.0:1788574109.858679:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747588864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.858685:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788574109.866664:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793286680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747588864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574109.876985:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574109.877007:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574109.877097:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747588992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574109.877158:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574109.877221:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7835756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.877305:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747588992 00000100:00100000:1.0:1788574109.877312:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747588992 00000100:00100000:1.0:1788574109.877393:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788574109.877403:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747588992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.877667:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747588992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.877675:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788574109.877720:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747588992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.877752:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.877787:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574109.877808:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69000 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.877820:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589120 00000100:00100000:1.0:1788574109.877823:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589120 00000100:00100000:1.0:1788574109.877843:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788574109.877862:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747589120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.877996:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747589120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.878003:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788574109.878035:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574109.882556:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8538:1875455747589248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574109.882638:0:8538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574109.882688:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7835756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574109.883088:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589248 00000100:00100000:3.0:1788574109.883096:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589248 00000100:00100000:3.0:1788574109.883164:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788574109.883174:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:8538:x1875455747589248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574109.883525:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:8538:x1875455747589248:12345-0@lo:502:llog_process_th.0 Request processed in 351us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574109.883534:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788574109.885859:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8538:1875455747589248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574109.885913:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574109.885925:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574109.885927:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788574109.885934:0:8538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6812f6000 00000020:00000080:2.0:1788574109.885936:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788574109.886040:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8538:1875455747589376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574109.886115:0:8538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574109.886144:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7835756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.888166:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589376 00000100:00100000:1.0:1788574109.888181:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589376 00000100:00100000:1.0:1788574109.888236:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788574109.888247:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:8538:x1875455747589376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574109.888553:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:8538:x1875455747589376:12345-0@lo:502:llog_process_th.0 Request processed in 308us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.888561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788574109.889101:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8538:1875455747589376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574109.889152:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574109.889161:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574109.889164:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788574109.889168:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788574109.889759:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788574109.889781:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574109.889792:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.889804:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574109.889816:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574109.889819:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a785e1b800 from 4 10000000:01000000:1.0:1788574109.889822:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574109.889872:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.889880:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.889889:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574109.889914:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.889964:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574109.889996:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.890014:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589504 00000100:00100000:1.0:1788574109.890019:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589504 00000100:00100000:1.0:1788574109.890057:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788574109.890066:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747589504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574109.890087:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574109.890101:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53595e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.890128:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.890839:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.890912:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21400, rc 0) 00000100:00100000:1.0:1788574109.890970:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747589504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 904us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.890977:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788574109.891031:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574109.891046:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574109.891055:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574109.891108:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.891195:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574109.891222:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.891235:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589632 00000100:00100000:1.0:1788574109.891239:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589632 00000100:00100000:1.0:1788574109.891260:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788574109.891267:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747589632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.891549:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747589632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.891556:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788574109.891585:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.891612:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.891651:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574109.891669:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.891680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589760 00000100:00100000:1.0:1788574109.891683:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589760 00000100:00100000:1.0:1788574109.891700:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788574109.891706:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747589760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.891849:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747589760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.896055:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788574109.897034:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747589760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574109.911176:0:8541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8541:1875455747589888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574109.911268:0:8541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574109.911316:0:8541:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574109.911453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747589888 00000100:00100000:3.0:1788574109.911463:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747589888 00000100:00100000:3.0:1788574109.911518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788574109.911528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:8541:x1875455747589888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574109.911737:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:8541:x1875455747589888:12345-0@lo:502:llog_process_th.0 Request processed in 210us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574109.911745:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788574109.911835:0:8541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8541:1875455747589888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574109.911866:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574109.911875:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574109.911877:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574109.911884:0:8541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a785e1b800 00000020:00000080:1.0:1788574109.911886:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788574109.911985:0:8541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8541:1875455747590016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574109.912020:0:8541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574109.912042:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590016 00000100:00100000:1.0:1788574109.912047:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590016 00000100:00100000:1.0:1788574109.912070:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788574109.912077:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:8541:x1875455747590016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574109.912191:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:8541:x1875455747590016:12345-0@lo:502:llog_process_th.0 Request processed in 114us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574109.912200:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788574109.912229:0:8541:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574109.912241:0:8541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8541:1875455747590016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574109.912257:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574109.912261:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574109.912263:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788574109.912266:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788574109.914742:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788574109.914774:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574109.914787:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.914800:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574109.914809:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574109.914812:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a790a3d000 from 4 10000000:01000000:3.0:1788574109.914815:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574109.914851:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.914858:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.914880:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574109.914905:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747590144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574109.914972:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574109.915026:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574109.915055:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590144 00000100:00100000:0.0:1788574109.915062:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590144 00000100:00100000:0.0:1788574109.915113:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788574109.915122:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747590144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574109.915159:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574109.915172:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53596c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.915195:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53596c expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.915205:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53596c expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.915660:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d800, rc 0) 00000100:00100000:0.0:1788574109.915709:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747590144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 588us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574109.915716:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788574109.916578:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747590144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574109.916608:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574109.916622:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574109.916708:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747590272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574109.916758:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574109.916804:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574109.916841:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590272 00000100:00100000:0.0:1788574109.916847:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590272 00000100:00100000:0.0:1788574109.916908:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788574109.916918:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747590272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574109.919036:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747590272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2108us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574109.919051:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788574109.919455:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747590272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574109.919522:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747590400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574109.919577:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574109.919606:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574109.919937:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590400 00000100:00100000:0.0:1788574109.919944:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590400 00000100:00100000:0.0:1788574109.919992:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788574109.920001:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747590400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574109.920199:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747590400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574109.920311:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788574109.924763:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747590400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574109.938901:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8543:1875455747590528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574109.939003:0:8543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574109.939066:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574109.939127:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590528 00000100:00100000:0.0:1788574109.939136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590528 00000100:00100000:0.0:1788574109.939187:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788574109.939198:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:8543:x1875455747590528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574109.939481:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:8543:x1875455747590528:12345-0@lo:502:llog_process_th.0 Request processed in 283us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574109.939488:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788574109.939657:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8543:1875455747590528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574109.939690:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574109.939702:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574109.939704:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574109.939713:0:8543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a790a3d000 00000020:00000080:3.0:1788574109.939716:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574109.939814:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8543:1875455747590656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574109.939853:0:8543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574109.939869:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574109.940557:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590656 00000100:00100000:0.0:1788574109.940565:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590656 00000100:00100000:0.0:1788574109.940614:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788574109.940625:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:8543:x1875455747590656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574109.940843:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:8543:x1875455747590656:12345-0@lo:502:llog_process_th.0 Request processed in 218us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574109.940849:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788574109.941026:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:8543:1875455747590656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574109.941061:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574109.941069:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574109.941071:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788574109.941075:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788574109.941315:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788574109.942480:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574109.942494:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574109.942508:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574110.019826:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574110.856138:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747590784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.856221:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574110.858113:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747591296:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.858399:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574110.858452:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574110.858461:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747591168:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.858489:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574110.858536:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747590912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.858564:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574110.858587:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747591424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.858608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574110.858627:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574110.858633:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747591040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.858653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574110.858691:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591296 00000100:00100000:0.0:1788574110.858700:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591296 00000100:00100000:0.0:1788574110.858756:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590912 00000100:00100000:0.0:1788574110.858760:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590912 00000100:00100000:0.0:1788574110.858774:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591040 00000100:00100000:0.0:1788574110.858776:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591040 00000100:00100000:0.0:1788574110.858793:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574110.858801:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747591296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574110.859730:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747590784 00000100:00100000:3.0:1788574110.859741:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747590784 00000100:00100000:3.0:1788574110.859800:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788574110.859809:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747590784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574110.860456:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747590784:12345-0@lo:400:kworker.0 Request processed in 646us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574110.860465:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788574110.860601:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747591296:12345-0@lo:400:kworker.0 Request processed in 1798us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.860609:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574110.860626:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574110.860633:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747590912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.860676:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747590912:12345-0@lo:400:kworker.0 Request processed in 44us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.860682:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574110.860702:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574110.860708:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747591040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.860737:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747591040:12345-0@lo:400:kworker.0 Request processed in 30us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.860743:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574110.860763:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591168 00000100:00100000:0.0:1788574110.860768:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591168 00000100:00100000:0.0:1788574110.860797:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591424 00000100:00100000:0.0:1788574110.860800:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591424 00000100:00100000:0.0:1788574110.860813:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574110.860818:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747591168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574110.861053:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747591040:0@lo:400:kworker.0 00000100:00100000:3.0:1788574110.861065:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747590912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.861394:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747591168:12345-0@lo:400:kworker.0 Request processed in 573us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.861402:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574110.861418:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574110.861425:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747591424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.861463:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747591424:12345-0@lo:400:kworker.0 Request processed in 40us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.861468:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788574110.861496:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574110.861500:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574110.861502:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574110.861529:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a793284000 x1875455747591424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574110.861541:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747591424:0@lo:400:kworker.0 00010000:00080000:0.0:1788574110.861570:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a793285880 x1875455747591168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574110.861595:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747591168:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.861606:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747590784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574110.861618:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747591296:0@lo:400:kworker.0 00010000:00010000:3.0:1788574111.042994:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574111.345143:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574111.354987:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638272 00000100:00100000:3.0:1788574111.355004:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638272 00000100:00100000:3.0:1788574111.355083:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 187 00000100:00100000:3.0:1788574111.355108:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+9:5596:x1875455727638272:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574111.355129:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574111.355155:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce36e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574111.355197:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574111.355213:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574111.355225:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b800, rc 0) 00000100:00100000:3.0:1788574111.355356:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638272:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 249us (10222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574111.355363:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 187 00000100:00100000:3.0:1788574111.358601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574111.358638:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638400 00000100:00100000:3.0:1788574111.358649:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638400 00000100:00100000:3.0:1788574111.358707:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 188 00000100:00100000:3.0:1788574111.358717:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638400:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574111.359028:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638400:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 311us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574111.359035:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 188 00000100:00100000:1.0:1788574111.370582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574111.372488:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747591552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574111.372572:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574111.372661:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638528 00000100:00100000:1.0:1788574111.373271:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638528 00000100:00100000:1.0:1788574111.373435:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 189 00000100:00100000:1.0:1788574111.373449:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638528:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574111.374045:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:5596:x1875455727638528:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 598us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574111.374065:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 189 00000100:00100000:1.0:1788574111.374885:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591552 00000100:00100000:1.0:1788574111.374896:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591552 00000100:00100000:1.0:1788574111.375292:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574111.375312:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747591552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574111.375347:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574111.375433:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747591552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574111.375440:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788574111.375486:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05180 x1875455747591552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574111.375507:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747591552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574111.385695:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574111.385732:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638656 00000100:00100000:3.0:1788574111.385742:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638656 00000100:00100000:3.0:1788574111.385784:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 190 00000100:00100000:3.0:1788574111.385802:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:6125:x1875455727638656:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574111.386026:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:6125:x1875455727638656:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 225us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574111.386034:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 190 00000100:00100000:2.0:1788574111.400551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574111.402442:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638784 00000100:00100000:1.0:1788574111.402456:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638784 00000100:00100000:1.0:1788574111.402533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 191 00000100:00100000:1.0:1788574111.402545:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:6125:x1875455727638784:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574111.402819:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:6125:x1875455727638784:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 275us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574111.402841:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 191 00000100:00100000:1.0:1788574112.044630:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574112.044684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574112.044717:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574112.044754:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727638912 00000100:00100000:1.0:1788574112.044767:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727638912 00000100:00100000:0.0:1788574112.045010:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639040 00000100:00100000:0.0:1788574112.045015:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639040 00000100:00100000:0.0:1788574112.045068:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788574112.045079:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727639040:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574112.045181:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727639040:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 103us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574112.045189:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788574112.045215:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639168 00000100:00100000:0.0:1788574112.045219:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639168 00000100:00100000:0.0:1788574112.045250:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:0.0:1788574112.045257:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727639168:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574112.045294:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727639168:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574112.045301:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00080000:0.0:1788574112.045318:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574112.045322:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574112.045940:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 192 00000100:00100000:1.0:1788574112.045964:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727638912:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574112.046003:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727638912:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 42us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574112.046010:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 192 00000100:00100000:1.0:1788574112.060706:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574112.060853:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639296 00000100:00100000:3.0:1788574112.060865:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639296 00000100:00100000:3.0:1788574112.060937:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574112.060948:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727639296:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574112.061025:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727639296:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574112.061033:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00080000:1.0:1788574112.061839:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788574112.064587:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574113.088759:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574113.927056:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747591680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574113.927155:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574113.927643:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591680 00000100:00100000:3.0:1788574113.927652:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591680 00000100:00100000:3.0:1788574113.927718:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574113.927727:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747591680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574113.927762:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788574113.927980:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574113.928021:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747591680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 294us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574113.928029:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788574113.929669:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05c00 x1875455747591680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574113.929695:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747591680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788574114.113218:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574115.137583:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574115.969401:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747591808:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.969476:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574115.969528:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747592320:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.969555:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574115.969598:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574115.969604:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.969631:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574115.969660:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747591936:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.969683:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574115.969700:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747592448:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.969718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574115.969736:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574115.969740:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747592064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.969985:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574115.970024:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591808 00000100:00100000:0.0:1788574115.970032:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591808 00000100:00100000:0.0:1788574115.970077:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788574115.970282:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747591808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.970338:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747591808:12345-0@lo:400:kworker.0 Request processed in 253us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.970345:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788574115.970401:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592320 00000100:00100000:0.0:1788574115.970406:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592320 00000100:00100000:0.0:1788574115.970439:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747591936 00000100:00100000:0.0:1788574115.970442:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747591936 00000100:00100000:0.0:1788574115.970453:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592064 00000100:00100000:0.0:1788574115.970456:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592064 00000100:00100000:0.0:1788574115.970468:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574115.970474:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747592320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.970507:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747592320:12345-0@lo:400:kworker.0 Request processed in 34us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.970513:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574115.970536:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574115.970541:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747591936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.970575:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747591936:12345-0@lo:400:kworker.0 Request processed in 34us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.970581:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574115.970593:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788574115.970598:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747592064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.970622:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747592064:12345-0@lo:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.970627:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788574115.970644:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592192 00000100:00100000:0.0:1788574115.970648:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592192 00000100:00100000:0.0:1788574115.970673:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592448 00000100:00100000:0.0:1788574115.970675:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592448 00000100:00100000:0.0:1788574115.970690:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574115.970695:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.970722:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747592192:12345-0@lo:400:kworker.0 Request processed in 28us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.970727:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574115.970736:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574115.970741:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747592448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.974692:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747592448:12345-0@lo:400:kworker.0 Request processed in 3939us (4961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.974709:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788574115.976053:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a793284000 x1875455747592192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574115.976624:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.976643:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747591808:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.976657:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747592320:0@lo:400:kworker.0 00000100:00080000:0.0:1788574115.976693:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574115.976699:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574115.976702:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574115.976722:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747592064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574115.976734:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747591936:0@lo:400:kworker.0 00010000:00080000:0.0:1788574115.976747:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a793287100 x1875455747592448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574115.977152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747592448:0@lo:400:kworker.0 00010000:00010000:2.0:1788574116.171073:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574116.485414:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574116.485509:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574116.485611:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592576 00000100:00100000:0.0:1788574116.485621:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592576 00000100:00100000:0.0:1788574116.485671:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574116.485681:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747592576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574116.485729:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574116.485793:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747592576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574116.485800:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788574116.486623:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8ed180 x1875455747592576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574116.486653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574117.164319:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574117.164394:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574117.164430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574117.164453:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574117.164480:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639808 00000100:00100000:0.0:1788574117.164490:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639808 00000100:00100000:0.0:1788574117.164543:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639680 00000100:00100000:0.0:1788574117.164547:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639680 00000100:00100000:0.0:1788574117.164567:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574117.164577:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727639808:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574117.164644:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727639808:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574117.164652:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574117.164949:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574117.164961:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727639680:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574117.165014:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727639680:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 56us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574117.165021:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574117.165042:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639424 00000100:00100000:0.0:1788574117.165045:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639424 00000100:00100000:0.0:1788574117.165070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 194 00000100:00100000:0.0:1788574117.165077:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:2354:x1875455727639424:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574117.165102:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+10:2354:x1875455727639424:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574117.165108:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 194 00000100:00080000:0.0:1788574117.165134:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574117.165138:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574117.165483:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639552 00000100:00100000:3.0:1788574117.165489:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639552 00000100:00100000:3.0:1788574117.165547:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:3.0:1788574117.165554:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727639552:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574117.165595:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727639552:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 42us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574117.165602:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00080000:2.0:1788574117.166160:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574117.184641:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574117.493439:0:8832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788574118.210172:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574119.047278:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574119.047307:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747592704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574119.047440:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.047610:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592704 00000100:00100000:1.0:1788574119.047619:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592704 00000100:00100000:1.0:1788574119.047685:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574119.047695:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747592704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574119.047733:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574119.047780:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747592704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.047787:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788574119.047856:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574119.047888:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05c00 x1875455747592704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574119.047907:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747592704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788574119.234552:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574120.259745:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574121.100085:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747593216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.100431:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574121.100511:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788574121.100519:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747592832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.100557:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574121.100583:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747593344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.100610:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574121.100642:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747592960:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.100693:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574121.100713:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747593472:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.100738:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574121.100755:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574121.100762:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747593088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.100782:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574121.100822:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593216 00000100:00100000:1.0:1788574121.100831:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593216 00000100:00100000:1.0:1788574121.100892:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593472 00000100:00100000:1.0:1788574121.100895:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593472 00000100:00100000:1.0:1788574121.100916:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574121.100927:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747593216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.101000:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747593216:12345-0@lo:400:kworker.0 Request processed in 60us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.101008:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574121.101026:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574121.101034:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747593472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.101436:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747593472:12345-0@lo:400:kworker.0 Request processed in 403us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.101443:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574121.101462:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592832 00000100:00100000:1.0:1788574121.101466:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592832 00000100:00100000:1.0:1788574121.101488:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788574121.101493:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747592832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.101522:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747592832:12345-0@lo:400:kworker.0 Request processed in 29us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.101539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788574121.101568:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593344 00000100:00100000:1.0:1788574121.101572:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593344 00000100:00100000:1.0:1788574121.101589:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747592960 00000100:00100000:1.0:1788574121.101591:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747592960 00000100:00100000:1.0:1788574121.101600:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593088 00000100:00100000:1.0:1788574121.101602:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593088 00000100:00100000:1.0:1788574121.101831:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574121.101838:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747593344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.101865:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747593344:12345-0@lo:400:kworker.0 Request processed in 29us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.101870:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574121.101879:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574121.101883:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747592960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.101903:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747592960:12345-0@lo:400:kworker.0 Request processed in 20us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.101907:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574121.101914:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574121.101918:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747593088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.101937:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747593088:12345-0@lo:400:kworker.0 Request processed in 19us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.101942:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788574121.101955:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574121.101960:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574121.101962:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574121.102127:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747592832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.102324:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747593344:0@lo:400:kworker.0 00010000:00080000:1.0:1788574121.102340:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1c00 x1875455747593216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574121.102350:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747593216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.104363:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747593088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574121.104395:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747592960:0@lo:400:kworker.0 00010000:00080000:1.0:1788574121.104411:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3480 x1875455747593472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574121.104422:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747593472:0@lo:400:kworker.0 00010000:00010000:1.0:1788574121.280629:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574121.600573:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747593600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574121.600647:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574121.600841:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593600 00000100:00100000:2.0:1788574121.600851:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593600 00000100:00100000:2.0:1788574121.600908:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574121.600918:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747593600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574121.600959:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574121.601006:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747593600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574121.601013:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788574121.601063:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8eca80 x1875455747593600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574121.601082:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747593600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574122.297225:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574122.297277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574122.297300:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574122.297306:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727639936 00000100:00100000:0.0:1788574122.297318:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727639936 00000100:00100000:0.0:1788574122.297392:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 196 00000100:00100000:2.0:1788574122.297393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574122.297403:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727639936:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574122.297415:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640064 00000100:00100000:2.0:1788574122.297428:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640064 00000100:00100000:2.0:1788574122.297468:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:0.0:1788574122.297470:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727639936:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574122.297475:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727640064:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574122.297477:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 196 00000100:00100000:2.0:1788574122.297505:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727640064:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574122.297511:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:2.0:1788574122.297530:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640192 00000100:00100000:2.0:1788574122.297534:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640192 00000100:00100000:2.0:1788574122.297568:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640320 00000100:00100000:2.0:1788574122.297572:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640320 00000100:00100000:2.0:1788574122.297588:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574122.297595:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2352:x1875455727640192:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:2.0:1788574122.297622:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5358b6 00000100:00080000:2.0:1788574122.297633:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a78f4fd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574122.297678:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1788574122.297699:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574122.298051:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+2:2352:x1875455727640192:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 455us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574122.298059:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574122.298074:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:2.0:1788574122.298080:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2352:x1875455727640320:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:2.0:1788574122.298095:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5358bd 00000100:00080000:2.0:1788574122.298102:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a78f4fa000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574122.298136:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788574122.298324:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+2:2352:x1875455727640320:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 243us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574122.298331:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00080000:2.0:1788574122.298356:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574122.298359:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574122.298362:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574122.298445:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574122.308734:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574123.112158:0:9076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing yml_node 00010000:00010000:0.0:1788574123.328517:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574124.164251:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747593728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574124.164343:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574124.164790:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593728 00000100:00100000:1.0:1788574124.164798:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593728 00000100:00100000:1.0:1788574124.164864:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574124.164874:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747593728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574124.164910:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788574124.165132:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574124.165326:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747593728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 452us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.165334:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788574124.165404:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e88b800 x1875455747593728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574124.165423:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747593728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788574124.355418:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574125.376747:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574126.211871:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747593984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.211963:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574126.212035:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747594496:0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.212075:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574126.212104:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574126.212110:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747594112:0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.212130:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574126.212168:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593984 00000100:00100000:3.0:1788574126.212177:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593984 00000100:00100000:3.0:1788574126.212219:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594112 00000100:00100000:3.0:1788574126.212222:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594112 00000100:00100000:3.0:1788574126.212251:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788574126.212261:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747593984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.212317:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747593984:12345-0@lo:400:kworker.0 Request processed in 58us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574126.212324:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788574126.212341:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574126.212346:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747594112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574126.212414:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594496 00000100:00100000:3.0:1788574126.212416:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747594112:12345-0@lo:400:kworker.0 Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574126.212418:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594496 00000100:00100000:3.0:1788574126.212438:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574126.212450:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788574126.212454:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574126.212457:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747594496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788574126.212458:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574126.212487:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747594496:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574126.212493:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574126.212576:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747594112:0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.212585:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747593984:0@lo:400:kworker.0 00010000:00080000:3.0:1788574126.212595:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28c380 x1875455747594496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574126.212604:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747594496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574126.212747:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747594240:0@lo:400:kworker.0 00000100:00100000:0.0:1788574126.212777:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574126.212803:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574126.212809:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747593856:0@lo:400:kworker.0 00000100:00100000:0.0:1788574126.212833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574126.212860:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747594368:0@lo:400:kworker.0 00000100:00100000:1.0:1788574126.212874:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747593856 00000100:00100000:1.0:1788574126.212878:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747593856 00000100:00100000:0.0:1788574126.212882:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574126.212903:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788574126.212910:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747593856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574126.212911:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594368 00000100:00100000:0.0:1788574126.212914:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594368 00000100:00100000:0.0:1788574126.212943:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574126.212944:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747593856:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574126.212949:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747594368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574126.212950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788574126.212988:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747594368:12345-0@lo:400:kworker.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574126.212993:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574126.213003:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747593856:0@lo:400:kworker.0 00000100:00100000:1.0:1788574126.213013:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747594368:0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.214118:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594240 00000100:00100000:3.0:1788574126.214131:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594240 00000100:00100000:3.0:1788574126.214190:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574126.214200:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747594240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574126.214278:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747594240:12345-0@lo:400:kworker.0 Request processed in 81us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574126.214285:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788574126.214308:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574126.214312:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574126.214731:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28d180 x1875455747594240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574126.214747:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747594240:0@lo:400:kworker.0 00010000:00010000:0.0:1788574126.402409:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574126.722430:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574126.722460:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747594624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574126.722544:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574126.724257:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594624 00000100:00100000:1.0:1788574126.724273:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594624 00000100:00100000:1.0:1788574126.724335:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574126.724345:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747594624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574126.724405:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574126.724480:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747594624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574126.724486:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788574126.726116:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3100 x1875455747594624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574126.726145:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747594624:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788574126.795054:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:0.0:1788574126.795073:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a78f4fd800/f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:1.0:1788574126.795165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78f4fd800/f540d78c-33c0-4206-a4f5-51879daa7a3f for lustre-OST0001 00000020:00000080:1.0:1788574126.795242:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a78f4fa000 for lustre-OST0001 00000001:00100000:3.0:1788574127.339071:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:3.0:1788574127.339081:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a78f4fb000/f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:0.0:1788574127.340248:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78f4fb000/f540d78c-33c0-4206-a4f5-51879daa7a3f for lustre-OST0000 00000020:00000080:0.0:1788574127.340661:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a78f4fd000 for lustre-OST0000 00000100:00100000:2.0:1788574127.407003:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574127.407071:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574127.407159:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640576 00000100:00100000:3.0:1788574127.407171:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640576 00000100:00100000:3.0:1788574127.407270:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:3.0:1788574127.407285:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727640576:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:1.0:1788574127.407410:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574127.407427:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727640576:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 146us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574127.407456:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788574127.407999:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640448 00000100:00100000:0.0:1788574127.408006:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640448 00000100:00100000:0.0:1788574127.408101:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 198 00000100:00100000:0.0:1788574127.408111:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2355:x1875455727640448:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574127.408157:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2355:x1875455727640448:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 48us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574127.408164:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 198 00010000:00010000:3.0:1788574127.425769:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574128.461899:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574128.670551:0:9272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788574129.284709:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747594752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574129.284795:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574129.286443:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594752 00000100:00100000:3.0:1788574129.286455:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594752 00000100:00100000:3.0:1788574129.286535:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574129.286548:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747594752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574129.286591:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788574129.286698:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574129.291246:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747594752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4690us (6441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574129.291261:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788574129.296150:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28c380 x1875455747594752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574129.296182:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747594752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788574129.478630:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574130.498229:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574131.329584:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747595264:0@lo:400:kworker.0 00000100:00100000:2.0:1788574131.329672:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574131.329732:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574131.329738:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747594880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574131.329765:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574131.329787:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747595392:0@lo:400:kworker.0 00000100:00100000:2.0:1788574131.329808:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574131.329836:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747594880 00000100:00100000:2.0:1788574131.329843:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747594880 00000100:00100000:2.0:1788574131.329895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788574131.329904:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747594880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574131.329950:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747594880:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574131.329968:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788574131.330028:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747594880:0@lo:400:kworker.0 00000100:00100000:1.0:1788574131.330106:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595264 00000100:00100000:1.0:1788574131.330111:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595264 00000100:00100000:1.0:1788574131.330161:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574131.330168:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747595264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574131.330207:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747595264:12345-0@lo:400:kworker.0 Request processed in 40us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574131.330213:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788574131.330265:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574131.330287:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3b80 x1875455747595264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574131.330298:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747595264:0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330400:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747595008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330431:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574131.330455:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747595520:0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574131.330498:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574131.330503:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747595136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574131.330560:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595392 00000100:00100000:0.0:1788574131.330563:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595392 00000100:00100000:0.0:1788574131.330590:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595008 00000100:00100000:0.0:1788574131.330593:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595008 00000100:00100000:0.0:1788574131.330604:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595136 00000100:00100000:0.0:1788574131.330606:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595136 00000100:00100000:0.0:1788574131.330618:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574131.330623:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747595392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330650:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747595392:12345-0@lo:400:kworker.0 Request processed in 28us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574131.330655:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574131.330663:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574131.330667:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747595008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330683:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747595008:12345-0@lo:400:kworker.0 Request processed in 16us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574131.330686:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574131.330692:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788574131.330695:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747595136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330708:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747595136:12345-0@lo:400:kworker.0 Request processed in 13us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574131.330711:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788574131.330721:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574131.330732:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747595136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330737:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747595008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574131.330750:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747595392:0@lo:400:kworker.0 00000100:00100000:3.0:1788574131.330877:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595520 00000100:00100000:3.0:1788574131.330880:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595520 00000100:00100000:3.0:1788574131.330903:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574131.330908:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747595520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574131.330934:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747595520:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574131.330938:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788574131.330967:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1f80 x1875455747595520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574131.330977:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747595520:0@lo:400:kworker.0 00000100:00080000:0.0:1788574131.331134:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788574131.520927:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574131.562905:0:9369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00000100:00100000:3.0:1788574131.845024:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747595648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574131.845116:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574131.847255:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595648 00000100:00100000:0.0:1788574131.847273:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595648 00000100:00100000:0.0:1788574131.847344:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574131.847356:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747595648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574131.847425:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574131.847523:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747595648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574131.847531:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788574131.849501:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1880 x1875455747595648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574131.849532:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747595648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788574132.545269:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574132.546601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574132.546663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574132.546795:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640832 00000100:00100000:1.0:1788574132.546816:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640832 00000100:00100000:1.0:1788574132.546891:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:1.0:1788574132.546911:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727640832:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574132.547009:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727640832:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 109us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574132.547016:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00080000:0.0:1788574132.547189:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574132.548545:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640704 00000100:00100000:3.0:1788574132.548557:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640704 00000100:00100000:3.0:1788574132.548612:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 200 00000100:00100000:3.0:1788574132.548622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2355:x1875455727640704:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574132.548687:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2355:x1875455727640704:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 66us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574132.548694:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 200 00010000:00010000:2.0:1788574133.568688:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574134.402198:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747595776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574134.402278:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574134.403114:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595776 00000100:00100000:3.0:1788574134.403127:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595776 00000100:00100000:3.0:1788574134.403213:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574134.403226:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747595776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574134.403272:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574134.403339:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747595776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574134.403347:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788574134.405067:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574134.405128:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28fb80 x1875455747595776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574134.405154:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747595776:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788574134.531265:0:9467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00010000:00010000:0.0:1788574134.593795:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574135.619321:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574136.448924:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747595904:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.448994:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.449051:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747596416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.449076:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.449099:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574136.449104:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747596288:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.449126:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.449149:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747596032:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.449191:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.449207:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747596544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.449232:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.449260:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574136.449265:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747596160:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.449284:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.449310:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596416 00000100:00100000:2.0:1788574136.449317:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596416 00000100:00100000:2.0:1788574136.449358:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596032 00000100:00100000:2.0:1788574136.449361:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596032 00000100:00100000:2.0:1788574136.449393:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596160 00000100:00100000:1.0:1788574136.449543:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747595904 00000100:00100000:1.0:1788574136.449548:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747595904 00000100:00100000:1.0:1788574136.449591:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788574136.449601:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747595904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574136.449664:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747595904:12345-0@lo:400:kworker.0 Request processed in 55us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574136.449672:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788574136.449737:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747595904:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.449921:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596160 00000100:00100000:2.0:1788574136.449948:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574136.449954:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747596416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.450068:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747596416:12345-0@lo:400:kworker.0 Request processed in 113us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574136.450075:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574136.450090:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574136.450096:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747596032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.450132:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747596032:12345-0@lo:400:kworker.0 Request processed in 36us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574136.450138:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574136.450149:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574136.450155:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747596160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.450180:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747596160:12345-0@lo:400:kworker.0 Request processed in 26us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574136.450185:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574136.450206:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596288 00000100:00100000:2.0:1788574136.450210:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596288 00000100:00100000:2.0:1788574136.450246:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596544 00000100:00100000:2.0:1788574136.450249:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596544 00000100:00100000:2.0:1788574136.450264:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574136.450270:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747596288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.450302:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747596288:12345-0@lo:400:kworker.0 Request processed in 31us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574136.450308:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574136.450318:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574136.450324:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747596544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.450350:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747596544:12345-0@lo:400:kworker.0 Request processed in 27us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574136.450355:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788574136.450568:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574136.450583:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574136.450586:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574136.452877:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747596160:0@lo:400:kworker.0 00000100:00100000:2.0:1788574136.452898:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747596032:0@lo:400:kworker.0 00010000:00080000:2.0:1788574136.452916:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1f80 x1875455747596544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574136.452926:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747596544:0@lo:400:kworker.0 00010000:00080000:1.0:1788574136.453733:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d0380 x1875455747596288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574136.453747:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747596288:0@lo:400:kworker.0 00000100:00100000:1.0:1788574136.453761:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747596416:0@lo:400:kworker.0 00010000:00010000:2.0:1788574136.649565:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574136.975734:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747596672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574136.975813:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574136.975909:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596672 00000100:00100000:2.0:1788574136.975917:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596672 00000100:00100000:2.0:1788574136.975976:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574136.975986:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747596672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574136.976032:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574136.976095:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747596672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574136.976103:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788574136.976145:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6fc000 x1875455747596672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574136.976164:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747596672:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788574137.043101:0:9515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 22:08:55 EDT 2026 00000100:00100000:2.0:1788574137.651132:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574137.651182:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574137.651253:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641088 00000100:00100000:3.0:1788574137.651264:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641088 00000100:00100000:1.0:1788574137.651342:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727640960 00000100:00100000:1.0:1788574137.651348:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727640960 00000100:00100000:3.0:1788574137.651349:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788574137.651359:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727641088:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574137.651404:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 202 00000100:00100000:1.0:1788574137.651411:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727640960:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788574137.651486:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574137.651577:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727641088:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 218us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574137.651584:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574137.660664:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727640960:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 6438us (6729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574137.660685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 202 00010000:00010000:0.0:1788574137.664678:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574138.700503:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574139.529153:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574139.529181:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574139.529262:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574139.529397:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596800 00000100:00100000:1.0:1788574139.529408:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596800 00000100:00100000:1.0:1788574139.529485:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574139.529498:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747596800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574139.529543:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574139.529596:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747596800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.529603:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788574139.529750:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788574139.529784:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1880 x1875455747596800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574139.529834:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747596800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788574139.719171:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574140.736634:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574141.569971:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747596928:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570067:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574141.570130:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747597440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570162:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574141.570197:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574141.570205:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747597312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570235:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574141.570265:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747597056:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574141.570305:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747597568:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570342:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574141.570360:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574141.570388:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747597184:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570438:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574141.570474:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597440 00000100:00100000:3.0:1788574141.570482:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597440 00000100:00100000:3.0:1788574141.570542:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597056 00000100:00100000:3.0:1788574141.570546:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597056 00000100:00100000:3.0:1788574141.570559:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597184 00000100:00100000:3.0:1788574141.570562:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597184 00000100:00100000:3.0:1788574141.570579:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574141.570589:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570650:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747597440:12345-0@lo:400:kworker.0 Request processed in 62us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574141.570668:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574141.570686:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788574141.570691:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747597056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570725:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747597056:12345-0@lo:400:kworker.0 Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574141.570731:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788574141.570743:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574141.570749:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747597184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570777:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747597184:12345-0@lo:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574141.570793:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574141.570812:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597312 00000100:00100000:3.0:1788574141.570816:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597312 00000100:00100000:3.0:1788574141.570840:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597568 00000100:00100000:3.0:1788574141.570842:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597568 00000100:00100000:3.0:1788574141.570853:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574141.570859:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747597312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570888:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747597312:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574141.570894:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574141.570904:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574141.570909:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747597568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.570932:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747597568:12345-0@lo:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574141.570937:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788574141.570972:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574141.570977:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574141.570979:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574141.571022:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747597184:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.571035:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747597056:0@lo:400:kworker.0 00010000:00080000:3.0:1788574141.571048:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28c380 x1875455747597568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574141.571059:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747597568:0@lo:400:kworker.0 00010000:00080000:3.0:1788574141.571095:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28dc00 x1875455747597312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574141.571103:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747597312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574141.571115:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747597440:0@lo:400:kworker.0 00000100:00100000:2.0:1788574141.572006:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747596928 00000100:00100000:2.0:1788574141.572021:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747596928 00000100:00100000:2.0:1788574141.572065:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788574141.572074:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747596928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574141.572161:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747596928:12345-0@lo:400:kworker.0 Request processed in 89us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574141.572167:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788574141.572224:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747596928:0@lo:400:kworker.0 00010000:00010000:2.0:1788574141.761567:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574142.080592:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747597696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574142.080744:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574142.080875:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597696 00000100:00100000:1.0:1788574142.080888:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597696 00000100:00100000:1.0:1788574142.080947:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574142.080957:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747597696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574142.080995:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574142.081070:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747597696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574142.081077:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788574142.081325:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6fea00 x1875455747597696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574142.081629:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747597696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574142.763692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574142.763743:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574142.763879:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641344 00000100:00100000:3.0:1788574142.763895:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641344 00000100:00100000:2.0:1788574142.763941:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641216 00000100:00100000:2.0:1788574142.763946:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641216 00000100:00100000:3.0:1788574142.763982:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:2.0:1788574142.763982:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 204 00000100:00100000:3.0:1788574142.763993:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727641344:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574142.763993:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727641216:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:1.0:1788574142.764067:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574142.764125:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727641216:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 134us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574142.764145:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 204 00000100:00100000:3.0:1788574142.768564:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727641344:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 4555us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574142.768609:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00010000:00010000:2.0:1788574142.791409:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574143.808528:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574144.640700:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574144.640736:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747597824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574144.640814:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574144.640894:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597824 00000100:00100000:1.0:1788574144.640904:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597824 00000100:00100000:1.0:1788574144.640967:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574144.640976:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747597824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574144.641017:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574144.641064:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747597824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574144.641072:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788574144.641093:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574144.641130:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3800 x1875455747597824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.641148:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747597824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788574144.833721:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574145.856729:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574146.689797:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747597952:0@lo:400:kworker.0 00000100:00100000:2.0:1788574146.689885:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574146.690016:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747597952 00000100:00100000:3.0:1788574146.690026:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747597952 00000100:00100000:3.0:1788574146.690076:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788574146.690098:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747597952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.691794:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747598080:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.691886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574146.691930:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574146.698221:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747598208:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.698338:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574146.698447:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598080 00000100:00100000:0.0:1788574146.698458:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598080 00000100:00100000:0.0:1788574146.698508:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598208 00000100:00100000:0.0:1788574146.698511:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598208 00000100:00100000:0.0:1788574146.698544:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574146.699338:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747598080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.699474:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747598080:12345-0@lo:400:kworker.0 Request processed in 902us (7581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574146.699483:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574146.699502:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788574146.699510:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747598208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.699538:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747598208:12345-0@lo:400:kworker.0 Request processed in 30us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574146.699556:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788574146.699595:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574146.699613:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747598336:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.699649:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574146.699687:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598336 00000100:00100000:0.0:1788574146.699701:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598336 00000100:00100000:0.0:1788574146.699738:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574146.699745:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747598336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.699779:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747598336:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574146.699802:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788574146.699820:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574146.699846:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3b80 x1875455747598336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574146.699860:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747598336:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.699888:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747598208:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.699898:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747598080:0@lo:400:kworker.0 00000100:00100000:3.0:1788574146.703011:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747597952:12345-0@lo:400:kworker.0 Request processed in 12908us (13108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574146.703031:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788574146.704228:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747597952:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.708143:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574146.708171:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747598464:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.708246:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574146.708290:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598464 00000100:00100000:0.0:1788574146.708298:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598464 00000100:00100000:0.0:1788574146.708352:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574146.708361:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747598464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.708435:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747598464:12345-0@lo:400:kworker.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574146.708442:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788574146.708462:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574146.708487:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747598464:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.708529:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747598592:0@lo:400:kworker.0 00000100:00100000:0.0:1788574146.708805:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574146.716003:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598592 00000100:00100000:3.0:1788574146.716019:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598592 00000100:00100000:3.0:1788574146.716091:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574146.716103:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747598592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574146.716208:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747598592:12345-0@lo:400:kworker.0 Request processed in 108us (7402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574146.716215:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788574146.716246:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574146.716800:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7719c00 x1875455747598592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574146.716815:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747598592:0@lo:400:kworker.0 00010000:00010000:1.0:1788574146.880680:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574147.206886:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747598720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574147.206964:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574147.207051:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598720 00000100:00100000:0.0:1788574147.207060:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598720 00000100:00100000:0.0:1788574147.207103:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574147.207113:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747598720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574147.207148:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574147.207195:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747598720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574147.207202:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788574147.207259:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7718000 x1875455747598720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574147.207278:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747598720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574147.892875:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574147.905097:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641600 00000100:00100000:1.0:1788574147.905117:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641600 00000100:00100000:1.0:1788574147.905214:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:1.0:1788574147.905226:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727641600:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574147.905314:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727641600:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 90us (12457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574147.905334:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00080000:3.0:1788574147.906020:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574147.907068:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574147.915905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574147.916240:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641472 00000100:00100000:0.0:1788574147.916255:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641472 00000100:00100000:0.0:1788574147.916320:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 206 00000100:00100000:0.0:1788574147.916332:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727641472:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574147.916447:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727641472:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 117us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574147.916455:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 206 00010000:00010000:3.0:1788574148.928674:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574149.760751:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747598848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574149.760854:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574149.761201:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598848 00000100:00100000:1.0:1788574149.761212:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598848 00000100:00100000:1.0:1788574149.761283:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574149.761292:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747598848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574149.761326:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574149.761406:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747598848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574149.761413:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788574149.761538:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574149.761752:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1500 x1875455747598848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574149.761782:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747598848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574149.953630:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574150.989394:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574151.808962:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747599104:0@lo:400:kworker.0 00000100:00100000:0.0:1788574151.809050:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574151.809120:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747599616:0@lo:400:kworker.0 00000100:00100000:0.0:1788574151.809147:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574151.809178:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574151.809184:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a771bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747599232:0@lo:400:kworker.0 00000100:00100000:0.0:1788574151.809203:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574151.809236:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599104 00000100:00100000:0.0:1788574151.809245:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599104 00000100:00100000:0.0:1788574151.809299:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599232 00000100:00100000:0.0:1788574151.809302:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599232 00000100:00100000:0.0:1788574151.809333:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574151.809342:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747599104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574151.809510:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a771ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747598976:0@lo:400:kworker.0 00000100:00100000:2.0:1788574151.809545:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574151.809568:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747599488:0@lo:400:kworker.0 00000100:00100000:2.0:1788574151.809588:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574151.809599:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574151.809612:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a771a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747599360:0@lo:400:kworker.0 00000100:00100000:2.0:1788574151.809634:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574151.809845:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574151.809874:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747598976 00000100:00100000:3.0:1788574151.809878:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747598976 00000100:00100000:3.0:1788574151.809918:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788574151.809926:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747598976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574151.809984:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747598976:12345-0@lo:400:kworker.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574151.809991:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788574151.810024:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599616 00000100:00100000:3.0:1788574151.810027:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599616 00000100:00100000:3.0:1788574151.810057:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599360 00000100:00100000:3.0:1788574151.810059:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599360 00000100:00100000:3.0:1788574151.810077:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574151.810082:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747599616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574151.810120:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747599616:12345-0@lo:400:kworker.0 Request processed in 37us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574151.810126:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574151.810136:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574151.810141:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747599360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574151.810165:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747599360:12345-0@lo:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574151.810169:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574151.810551:0:5858:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574151.810561:0:5858:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788574151.810582:0:5859:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574151.810588:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599488 00000100:00100000:1.0:1788574151.810591:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599488 00000100:00100000:1.0:1788574151.810621:0:5859:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574151.810628:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574151.810635:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747599232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574151.810671:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747599232:12345-0@lo:400:kworker.0 Request processed in 37us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574151.810677:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574151.810688:0:5859:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574151.810693:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574151.810698:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747599488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574151.810724:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747599488:12345-0@lo:400:kworker.0 Request processed in 26us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574151.810730:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788574151.812043:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574151.812050:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574151.812052:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574151.812103:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a771a300 x1875455747599360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574151.812119:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a771a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747599360:0@lo:400:kworker.0 00000100:00100000:3.0:1788574151.812151:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a771ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747598976:0@lo:400:kworker.0 00000100:00100000:3.0:1788574151.812165:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747599488:0@lo:400:kworker.0 00000100:00100000:3.0:1788574151.812283:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a771bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747599232:0@lo:400:kworker.0 00010000:00080000:3.0:1788574151.812297:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7719880 x1875455747599616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574151.812305:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747599616:0@lo:400:kworker.0 00000100:00100000:1.0:1788574151.812469:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747599104:12345-0@lo:400:kworker.0 Request processed in 3126us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574151.812480:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788574151.813461:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747599104:0@lo:400:kworker.0 00010000:00010000:3.0:1788574152.006265:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574152.322207:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574152.322235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747599744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574152.324463:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574152.325214:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599744 00000100:00100000:0.0:1788574152.325230:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599744 00000100:00100000:0.0:1788574152.327314:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574152.327332:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747599744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574152.327391:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574152.327474:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747599744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574152.327481:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788574152.330864:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6ffb80 x1875455747599744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574152.330900:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747599744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574153.022191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574153.022234:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574153.022435:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641728 00000100:00100000:1.0:1788574153.022446:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641728 00000100:00100000:1.0:1788574153.022506:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 208 00000100:00100000:1.0:1788574153.022517:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727641728:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574153.022579:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727641728:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 64us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574153.022596:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 208 00000100:00100000:3.0:1788574153.022731:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641856 00000100:00100000:3.0:1788574153.022736:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641856 00000100:00100000:3.0:1788574153.022800:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:3.0:1788574153.022807:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727641856:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574153.022842:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727641856:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 36us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574153.022848:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00080000:1.0:1788574153.023473:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574153.024735:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574154.048629:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574154.684213:0:10147:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:09:13 (1788574153) === 00000100:00100000:3.0:1788574154.881068:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574154.881092:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747599872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574154.881160:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574154.881267:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747599872 00000100:00100000:1.0:1788574154.881276:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747599872 00000100:00100000:1.0:1788574154.881337:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574154.881346:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747599872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574154.881396:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574154.881454:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747599872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.881461:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788574154.881540:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3100 x1875455747599872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574154.881583:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747599872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788574154.881604:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788574155.073137:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574155.340459:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574155.340534:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727641984 00000100:00100000:2.0:1788574155.340553:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727641984 00000100:00100000:2.0:1788574155.340612:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:2.0:1788574155.340625:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+10:8120:x1875455727641984:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574155.340644:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574155.340678:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985600/0x10531a153b535981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce36e8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574155.340710:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985600/0x10531a153b535981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e8 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574155.340723:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985600/0x10531a153b535981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e8 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574155.340733:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985600, rc 0) 00000100:00100000:2.0:1788574155.340807:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:8120:x1875455727641984:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 184us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574155.340814:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:3.0:1788574155.349252:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574155.349526:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642112 00000100:00100000:0.0:1788574155.349553:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642112 00000100:00100000:0.0:1788574155.349632:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:0.0:1788574155.349646:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+11:8120:x1875455727642112:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574155.350030:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+11:8120:x1875455727642112:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 385us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574155.350038:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:0.0:1788574155.365847:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.365963:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642240 00000100:00100000:1.0:1788574155.365977:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642240 00000100:00100000:1.0:1788574155.366038:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:1.0:1788574155.366049:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+11:8120:x1875455727642240:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788574155.366340:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+11:8120:x1875455727642240:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 281us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574155.366362:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:1.0:1788574155.372287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574155.374957:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642368 00000100:00100000:2.0:1788574155.374976:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642368 00000100:00100000:2.0:1788574155.375169:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:2.0:1788574155.375181:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:8124:x1875455727642368:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574155.375609:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:8124:x1875455727642368:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 428us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574155.375619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:3.0:1788574155.398043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574155.400133:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642496 00000100:00100000:0.0:1788574155.400153:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642496 00000100:00100000:0.0:1788574155.400242:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:0.0:1788574155.400265:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+11:8124:x1875455727642496:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574155.400925:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+11:8124:x1875455727642496:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 669us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574155.400934:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:0.0:1788574155.412791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574155.412883:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642624 00000100:00100000:2.0:1788574155.412897:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642624 00000100:00100000:2.0:1788574155.412967:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00100000:2.0:1788574155.412980:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:8120:x1875455727642624:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574155.413001:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574155.413024:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985e00/0x10531a153b535988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3712 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574155.413083:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985e00/0x10531a153b535988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3712 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574155.413098:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985e00/0x10531a153b535988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3712 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574155.413109:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985e00, rc 0) 00000100:00100000:2.0:1788574155.413171:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:8120:x1875455727642624:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 193us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574155.413178:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00100000:2.0:1788574155.424876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.424994:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642752 00000100:00100000:1.0:1788574155.425005:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642752 00000100:00100000:1.0:1788574155.425088:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:1.0:1788574155.425099:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:8120:x1875455727642752:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788574155.425126:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788574155.425151:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788574155.425156:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788574155.425159:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788574155.425161:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788574155.431776:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:8120:x1875455727642752:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 6665us (6898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574155.431791:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:0.0:1788574155.434526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574155.434642:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727642880 00000100:00100000:3.0:1788574155.434651:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727642880 00000100:00100000:3.0:1788574155.434709:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:3.0:1788574155.434720:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+12:8120:x1875455727642880:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574155.434740:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574155.434759:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3719 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574155.434786:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574155.434794:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574155.434802:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a000, rc 0) 00000100:00100000:3.0:1788574155.434868:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:8120:x1875455727642880:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 141us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574155.434876:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:2.0:1788574155.437950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.438072:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643008 00000100:00100000:1.0:1788574155.438086:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643008 00000100:00100000:1.0:1788574155.441129:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:1.0:1788574155.441150:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:8120:x1875455727643008:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788574155.442827:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:8120:x1875455727643008:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 1667us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574155.442841:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:0.0:1788574155.447713:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574155.447927:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643136 00000100:00100000:3.0:1788574155.447939:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643136 00000100:00100000:0.0:1788574155.448636:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:0.0:1788574155.448651:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:8120:x1875455727643136:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574155.448896:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:8120:x1875455727643136:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 249us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574155.448913:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:0.0:1788574155.454298:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.454651:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643264 00000100:00100000:1.0:1788574155.454664:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643264 00000100:00100000:1.0:1788574155.454724:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:1.0:1788574155.454735:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:8129:x1875455727643264:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574155.455845:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:8129:x1875455727643264:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 1104us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574155.455857:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:2.0:1788574155.461819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574155.463746:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643392 00000100:00100000:3.0:1788574155.463763:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643392 00000100:00100000:2.0:1788574155.463970:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:2.0:1788574155.463983:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:8129:x1875455727643392:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574155.464294:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:8129:x1875455727643392:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 311us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574155.464302:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:0.0:1788574155.476674:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574155.476729:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574155.480303:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643520 00000100:00100000:2.0:1788574155.480319:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643520 00000100:00100000:2.0:1788574155.481808:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643648 00000100:00100000:2.0:1788574155.481826:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643648 00000100:00100000:2.0:1788574155.481921:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:2.0:1788574155.481932:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727643648:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574155.482126:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788574155.482133:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875455727643520:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788574155.482161:0:5859:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bbb204bb-74e4-44f7-ac26-18a0bfa744ec@192.168.201.57@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788574155.482204:0:5859:0:(genops.c:1385:class_connect()) connect: client bbb204bb-74e4-44f7-ac26-18a0bfa744ec, cookie 0x10531a153b535996 00000004:00100000:3.0:1788574155.482234:0:5859:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788574155.482851:0:5859:0:(import.c:65:import_set_state_nolock()) ffff90a681296000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574155.482909:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2352:x1875455727643520:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 774us (6584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574155.482933:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00080000:0.0:1788574155.483865:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574155.485152:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727643648:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 3210us (8410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574155.485179:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:0.0:1788574155.488935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574155.489093:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.490210:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643776 00000100:00100000:1.0:1788574155.490225:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643776 00000100:00100000:1.0:1788574155.490660:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727643904 00000100:00100000:1.0:1788574155.490665:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727643904 00000100:00100000:3.0:1788574155.490722:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574155.490734:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+7:0:x1875455727643776:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574155.490780:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788574155.490898:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+7:0:x1875455727643776:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 165us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574155.490907:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574155.490930:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574155.490938:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:8120:x1875455727643904:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574155.490949:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788574155.490971:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:8120:x1875455727643904:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 35us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574155.490977:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00080000:0.0:1788574155.491024:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574155.500845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574155.501666:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644032 00000100:00100000:2.0:1788574155.501681:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644032 00000100:00100000:2.0:1788574155.501761:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574155.501773:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:8120:x1875455727644032:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788574155.501907:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:8120:x1875455727644032:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 136us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574155.501915:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574155.506953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574155.507331:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644160 00000100:00100000:3.0:1788574155.507348:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644160 00000100:00100000:3.0:1788574155.507470:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574155.507479:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875455727644160:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574155.507743:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bbb204bb-74e4-44f7-ac26-18a0bfa744ec@192.168.201.57@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788574155.507781:0:6711:0:(genops.c:1385:class_connect()) connect: client bbb204bb-74e4-44f7-ac26-18a0bfa744ec, cookie 0x10531a153b53599d 00002000:00100000:3.0:1788574155.507791:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bbb204bb-74e4-44f7-ac26-18a0bfa744ec/ffff90a681291800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574155.507803:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574155.508962:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788574155.509059:0:6711:0:(import.c:65:import_set_state_nolock()) ffff90a681297800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574155.509160:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2352:x1875455727644160:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 1678us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574155.509171:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788574155.511469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.511626:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644288 00000100:00100000:1.0:1788574155.511636:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644288 00000100:00100000:1.0:1788574155.511677:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574155.511687:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875455727644288:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788574155.511720:0:6713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bbb204bb-74e4-44f7-ac26-18a0bfa744ec@192.168.201.57@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:1.0:1788574155.511754:0:6713:0:(genops.c:1385:class_connect()) connect: client bbb204bb-74e4-44f7-ac26-18a0bfa744ec, cookie 0x10531a153b5359a4 00002000:00100000:1.0:1788574155.511767:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bbb204bb-74e4-44f7-ac26-18a0bfa744ec/ffff90a7bb2e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788574155.511792:0:6713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788574155.512041:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788574155.512085:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574155.512165:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2352:x1875455727644288:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 477us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574155.512173:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788574155.517942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574155.518258:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644416 00000100:00100000:1.0:1788574155.518268:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644416 00000100:00100000:1.0:1788574155.518326:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:1.0:1788574155.518645:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:8120:x1875455727644416:12345-192.168.201.57@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788574155.518722:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788574155.518820:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:8120:x1875455727644416:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 178us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574155.523659:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00010000:00010000:1.0:1788574156.100244:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574156.933492:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747600000:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.933604:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574156.933665:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747600512:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.933701:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574156.933733:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574156.933739:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747600384:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.933768:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574156.933800:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747600256:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.933824:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574156.933844:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788574156.933850:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747600128:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.933872:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574156.933887:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747600640:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.933911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574156.933948:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600000 00000100:00100000:1.0:1788574156.933959:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600000 00000100:00100000:1.0:1788574156.934024:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788574156.934036:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747600000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934119:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747600000:12345-0@lo:400:kworker.0 Request processed in 85us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574156.934128:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788574156.934174:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600512 00000100:00100000:1.0:1788574156.934193:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600512 00000100:00100000:1.0:1788574156.934234:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600256 00000100:00100000:1.0:1788574156.934238:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600256 00000100:00100000:1.0:1788574156.934250:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600128 00000100:00100000:1.0:1788574156.934252:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600128 00000100:00100000:1.0:1788574156.934264:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788574156.934270:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747600512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934302:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747600512:12345-0@lo:400:kworker.0 Request processed in 32us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574156.934308:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788574156.934319:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574156.934325:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747600256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934355:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747600256:12345-0@lo:400:kworker.0 Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574156.934361:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574156.934414:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788574156.934420:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747600128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934447:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747600128:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574156.934453:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788574156.934470:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600384 00000100:00100000:1.0:1788574156.934473:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600384 00000100:00100000:1.0:1788574156.934501:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600640 00000100:00100000:1.0:1788574156.934505:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600640 00000100:00100000:1.0:1788574156.934533:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574156.934540:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747600384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934571:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747600384:12345-0@lo:400:kworker.0 Request processed in 32us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574156.934586:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574156.934598:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574156.934603:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747600640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934630:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747600640:12345-0@lo:400:kworker.0 Request processed in 27us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574156.934636:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788574156.934677:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1c00 x1875455747600384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574156.934693:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747600384:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934705:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747600000:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934717:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747600512:0@lo:400:kworker.0 00000100:00080000:1.0:1788574156.934749:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574156.934753:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574156.934757:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574156.934777:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747600128:0@lo:400:kworker.0 00010000:00080000:1.0:1788574156.934789:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3b80 x1875455747600640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574156.934798:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747600640:0@lo:400:kworker.0 00000100:00100000:1.0:1788574156.934810:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747600256:0@lo:400:kworker.0 00000001:00100000:3.0:1788574157.036150:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00010000:00010000:0.0:1788574157.122327:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574157.441044:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574157.441070:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747600768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574157.441150:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574157.441901:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600768 00000100:00100000:1.0:1788574157.441914:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600768 00000100:00100000:1.0:1788574157.441974:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574157.441983:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747600768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574157.442030:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574157.442103:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747600768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574157.442110:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788574157.442152:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5d500 x1875455747600768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574157.442171:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747600768:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788574157.548192:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000001:00100000:3.0:1788574158.000838:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00010000:00010000:3.0:1788574158.144529:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574159.175618:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574160.001518:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747600896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574160.001607:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574160.001727:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747600896 00000100:00100000:1.0:1788574160.001739:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747600896 00000100:00100000:1.0:1788574160.001824:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574160.001835:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747600896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574160.001871:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574160.001920:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747600896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574160.001927:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788574160.002098:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574160.002134:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3800 x1875455747600896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574160.002154:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747600896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574160.192609:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574160.689103:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574160.689162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574160.689201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574160.689285:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644800 00000100:00100000:3.0:1788574160.689298:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644800 00000100:00100000:3.0:1788574160.689431:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644672 00000100:00100000:3.0:1788574160.689435:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644672 00000100:00100000:3.0:1788574160.689486:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:3.0:1788574160.689498:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727644800:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574160.689596:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727644800:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 100us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574160.689605:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:3.0:1788574160.689625:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788574160.689631:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727644672:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574160.689656:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727644672:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574160.689662:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:0.0:1788574160.689830:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644544 00000100:00100000:0.0:1788574160.689835:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644544 00000100:00100000:0.0:1788574160.689876:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:0.0:1788574160.689884:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727644544:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574160.689938:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727644544:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 55us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574160.689944:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:0.0:1788574160.690669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574160.690703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00080000:2.0:1788574160.690832:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574160.690862:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645056 00000100:00100000:1.0:1788574160.690869:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645056 00000100:00100000:1.0:1788574160.690934:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727644928 00000100:00100000:1.0:1788574160.690937:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727644928 00000100:00100000:3.0:1788574160.690953:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:1.0:1788574160.690961:0:6713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788574160.690962:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727645056:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574160.690971:0:6713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788574160.691020:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727645056:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574160.691040:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788574160.691056:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788574160.691062:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727644928:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574160.691084:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727644928:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574160.691090:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00080000:2.0:1788574160.691206:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574160.691209:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788574161.217091:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574162.051767:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747601152:0@lo:400:kworker.0 00000100:00100000:3.0:1788574162.051806:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747601408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574162.051974:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747601280:0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.052113:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747601024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574162.056837:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574162.056948:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601408 00000100:00100000:3.0:1788574162.057024:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601408 00000100:00100000:3.0:1788574162.057210:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788574162.057223:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747601408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574162.057290:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747601408:12345-0@lo:400:kworker.0 Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574162.057297:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788574162.057543:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3100 x1875455747601408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574162.057563:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747601408:0@lo:400:kworker.0 00000100:00080000:3.0:1788574162.058482:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574162.060961:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574162.061133:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601152 00000100:00100000:1.0:1788574162.061143:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601152 00000100:00100000:1.0:1788574162.061201:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788574162.061213:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747601152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574162.061628:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747601152:12345-0@lo:400:kworker.0 Request processed in 417us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574162.061637:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788574162.061698:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747601152:0@lo:400:kworker.0 00000100:00100000:1.0:1788574162.061712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747601664:0@lo:400:kworker.0 00000100:00100000:1.0:1788574162.061766:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574162.061793:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601664 00000100:00100000:1.0:1788574162.061797:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601664 00000100:00100000:1.0:1788574162.061830:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574162.061836:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747601664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574162.061870:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747601664:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574162.061876:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788574162.061892:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788574162.061928:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d3800 x1875455747601664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574162.061941:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747601664:0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.062753:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574162.062796:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601024 00000100:00100000:2.0:1788574162.062803:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601024 00000100:00100000:2.0:1788574162.062839:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788574162.062846:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747601024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.062883:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747601024:12345-0@lo:400:kworker.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574162.062890:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788574162.062958:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747601024:0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.062981:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747601536:0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.063011:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574162.065250:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574162.065477:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601536 00000100:00100000:2.0:1788574162.065488:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601536 00000100:00100000:2.0:1788574162.065554:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601280 00000100:00100000:2.0:1788574162.065558:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601280 00000100:00100000:2.0:1788574162.065585:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788574162.065597:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747601536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.065667:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747601536:12345-0@lo:400:kworker.0 Request processed in 73us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574162.065674:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788574162.065692:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788574162.065697:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747601280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.065733:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747601280:12345-0@lo:400:kworker.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574162.065739:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788574162.065759:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574162.065802:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747601536:0@lo:400:kworker.0 00000100:00100000:2.0:1788574162.065926:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747601280:0@lo:400:kworker.0 00010000:00010000:2.0:1788574162.247787:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574162.317966:0:10344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1788574162.562025:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574162.562054:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747601792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574162.562139:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574162.562248:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601792 00000100:00100000:2.0:1788574162.562258:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601792 00000100:00100000:2.0:1788574162.562312:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574162.562322:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747601792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574162.562355:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574162.562453:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747601792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574162.562461:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788574162.562504:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6fd180 x1875455747601792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574162.562525:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747601792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574163.264580:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574164.288661:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574165.125255:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747601920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574165.125330:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574165.125479:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747601920 00000100:00100000:0.0:1788574165.125487:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747601920 00000100:00100000:0.0:1788574165.125548:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574165.125557:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747601920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574165.125594:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788574165.126299:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574165.132472:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747601920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6907us (7132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.132486:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788574165.132631:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7bedf80 x1875455747601920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574165.132656:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747601920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788574165.312647:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574165.804534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574165.804583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574165.804617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574165.804650:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574165.804676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574165.804722:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645440 00000100:00100000:3.0:1788574165.804733:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645440 00000100:00100000:3.0:1788574165.804794:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645312 00000100:00100000:3.0:1788574165.804797:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645312 00000100:00100000:3.0:1788574165.804820:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:3.0:1788574165.804828:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727645440:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574165.804894:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727645440:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.804900:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:3.0:1788574165.804915:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:3.0:1788574165.804920:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727645312:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574165.804937:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727645312:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 17us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.804943:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:3.0:1788574165.804957:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645696 00000100:00100000:3.0:1788574165.804960:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645696 00000100:00100000:3.0:1788574165.804980:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645568 00000100:00100000:3.0:1788574165.804982:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645568 00000100:00100000:3.0:1788574165.805001:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788574165.805007:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79106fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727645696:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574165.805030:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79106fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727645696:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.805035:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788574165.805185:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:3.0:1788574165.805192:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727645568:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574165.805212:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727645568:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 21us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.805223:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00080000:3.0:1788574165.805246:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574165.805249:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574165.805252:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574165.805818:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645184 00000100:00100000:0.0:1788574165.805825:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645184 00000100:00100000:0.0:1788574165.805871:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 224 00000100:00100000:0.0:1788574165.805879:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727645184:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574165.805925:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727645184:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 47us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.805932:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 224 00010000:00010000:0.0:1788574166.337765:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574167.171045:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747602432:0@lo:400:kworker.0 00000100:00100000:0.0:1788574167.171143:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574167.171210:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574167.171216:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747602048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574167.171239:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574167.171260:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747602560:0@lo:400:kworker.0 00000100:00100000:0.0:1788574167.171284:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574167.171315:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747602176:0@lo:400:kworker.0 00000100:00100000:0.0:1788574167.171339:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574167.171385:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747602688:0@lo:400:kworker.0 00000100:00100000:0.0:1788574167.171418:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574167.171433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574167.171438:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747602304:0@lo:400:kworker.0 00000100:00100000:0.0:1788574167.171458:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574167.171574:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602432 00000100:00100000:3.0:1788574167.171584:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602432 00000100:00100000:3.0:1788574167.171659:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602688 00000100:00100000:3.0:1788574167.171662:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602688 00000100:00100000:3.0:1788574167.171687:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574167.171696:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.171771:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747602432:12345-0@lo:400:kworker.0 Request processed in 77us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.171780:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574167.171799:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788574167.171807:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747602688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.171844:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747602688:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.171850:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788574167.171868:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602560 00000100:00100000:3.0:1788574167.171871:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602560 00000100:00100000:3.0:1788574167.171895:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602176 00000100:00100000:3.0:1788574167.171898:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602176 00000100:00100000:3.0:1788574167.171909:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602304 00000100:00100000:3.0:1788574167.171911:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602304 00000100:00100000:3.0:1788574167.171924:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788574167.171932:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747602560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.171968:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747602560:12345-0@lo:400:kworker.0 Request processed in 36us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.171987:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788574167.172004:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574167.172012:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.172042:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747602176:12345-0@lo:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.172048:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574167.172058:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788574167.172063:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747602304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.172087:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747602304:12345-0@lo:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.172092:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788574167.172153:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747602304:0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.172164:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747602176:0@lo:400:kworker.0 00010000:00080000:3.0:1788574167.172175:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5df80 x1875455747602688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574167.172186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747602688:0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.172219:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747602560:0@lo:400:kworker.0 00010000:00080000:3.0:1788574167.172229:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5fb80 x1875455747602432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574167.172237:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747602432:0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.172264:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602048 00000100:00100000:3.0:1788574167.172268:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602048 00000100:00100000:3.0:1788574167.172305:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788574167.172312:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747602048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574167.172364:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747602048:12345-0@lo:400:kworker.0 Request processed in 53us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.172394:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788574167.172429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747602048:0@lo:400:kworker.0 00000100:00080000:0.0:1788574167.173859:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574167.173868:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574167.173871:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788574167.365637:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574167.684873:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747602816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574167.684948:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574167.684995:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602816 00000100:00100000:0.0:1788574167.685002:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602816 00000100:00100000:0.0:1788574167.685046:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574167.685054:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747602816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574167.685093:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574167.685142:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747602816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574167.685149:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788574167.685582:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6fca80 x1875455747602816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574167.685614:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747602816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574168.387241:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574169.408511:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574170.244163:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574170.244188:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747602944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574170.244288:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574170.244429:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747602944 00000100:00100000:1.0:1788574170.244440:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747602944 00000100:00100000:1.0:1788574170.244507:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574170.244517:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747602944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574170.244571:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574170.244629:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747602944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574170.244637:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788574170.244660:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574170.244697:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7bed880 x1875455747602944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574170.244719:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747602944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574170.438596:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574170.924531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574170.924632:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645952 00000100:00100000:1.0:1788574170.924645:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645952 00000100:00100000:1.0:1788574170.924720:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:1.0:1788574170.924731:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727645952:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574170.924810:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727645952:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574170.924817:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00080000:3.0:1788574170.925034:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574170.925623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574170.925664:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574170.925687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574170.925709:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574170.925729:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727645824 00000100:00100000:3.0:1788574170.925736:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727645824 00000100:00100000:3.0:1788574170.925769:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 226 00000100:00100000:3.0:1788574170.925777:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727645824:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574170.925819:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727645824:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 42us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574170.925826:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 226 00000100:00100000:3.0:1788574170.925854:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646080 00000100:00100000:3.0:1788574170.925870:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646080 00000100:00100000:3.0:1788574170.925901:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788574170.925909:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727646080:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574170.925937:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727646080:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574170.925943:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788574170.925961:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646208 00000100:00100000:3.0:1788574170.925964:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646208 00000100:00100000:3.0:1788574170.925988:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646336 00000100:00100000:3.0:1788574170.925991:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646336 00000100:00100000:3.0:1788574170.926008:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:3.0:1788574170.926014:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727646208:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574170.926038:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727646208:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574170.926044:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:3.0:1788574170.926053:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:3.0:1788574170.926059:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727646336:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574170.929238:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727646336:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 3165us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574170.929254:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00080000:3.0:1788574170.929330:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574170.929334:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574170.929338:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574171.457514:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574172.288608:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747603072:0@lo:400:kworker.0 00000100:00100000:0.0:1788574172.288644:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747603200:0@lo:400:kworker.0 00000100:00100000:3.0:1788574172.288818:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747603456:0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.292112:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574172.292220:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747603584:0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.292313:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574172.292365:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603584 00000100:00100000:1.0:1788574172.292390:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603584 00000100:00100000:1.0:1788574172.292465:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788574172.292474:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747603584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.292535:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747603584:12345-0@lo:400:kworker.0 Request processed in 62us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574172.292542:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788574172.292565:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574172.292602:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747603584:0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.292650:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747603328:0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.292678:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574172.292733:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603072 00000100:00100000:1.0:1788574172.292737:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603072 00000100:00100000:1.0:1788574172.292768:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788574172.292775:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747603072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.292823:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747603072:12345-0@lo:400:kworker.0 Request processed in 50us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574172.292830:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788574172.292867:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747603072:0@lo:400:kworker.0 00000100:00100000:3.0:1788574172.296019:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603328 00000100:00100000:3.0:1788574172.296042:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603328 00000100:00100000:3.0:1788574172.296150:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788574172.296161:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747603328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574172.296294:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747603328:12345-0@lo:400:kworker.0 Request processed in 135us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574172.296316:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788574172.296354:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574172.296415:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747603328:0@lo:400:kworker.0 00000100:00100000:3.0:1788574172.296480:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574172.296516:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603456 00000100:00100000:3.0:1788574172.296521:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603456 00000100:00100000:3.0:1788574172.296551:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788574172.296557:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747603456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574172.296590:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747603456:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574172.296597:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788574172.296614:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788574172.296633:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5e300 x1875455747603456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574172.296645:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747603456:0@lo:400:kworker.0 00000100:00100000:0.0:1788574172.300749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574172.301532:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747603712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574172.301599:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574172.303514:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603712 00000100:00100000:3.0:1788574172.303539:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603712 00000100:00100000:3.0:1788574172.303634:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788574172.303648:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747603712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574172.303757:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747603712:12345-0@lo:400:kworker.0 Request processed in 112us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574172.303765:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788574172.304839:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788574172.304901:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5ed80 x1875455747603712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574172.304920:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747603712:0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.307294:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603200 00000100:00100000:1.0:1788574172.307481:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603200 00000100:00100000:1.0:1788574172.307565:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788574172.307579:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747603200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574172.307691:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747603200:12345-0@lo:400:kworker.0 Request processed in 115us (6949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574172.307698:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574172.308294:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747603200:0@lo:400:kworker.0 00010000:00010000:0.0:1788574172.485623:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574172.808892:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574172.808924:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747603840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574172.809016:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574172.823486:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603840 00000100:00100000:3.0:1788574172.823508:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603840 00000100:00100000:3.0:1788574172.823590:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574172.823604:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747603840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574172.823655:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574172.823743:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747603840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (14726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574172.823751:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788574172.825913:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6fc380 x1875455747603840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574172.825941:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747603840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788574173.507338:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574174.528533:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574175.360788:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574175.360811:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747603968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574175.360893:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.361026:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747603968 00000100:00100000:1.0:1788574175.361053:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747603968 00000100:00100000:1.0:1788574175.361127:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574175.361137:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747603968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574175.361171:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574175.361255:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747603968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.361263:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788574175.361583:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7beca80 x1875455747603968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574175.361614:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747603968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574175.362413:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788574175.561901:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574176.049322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574176.049362:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574176.049466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574176.049543:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646592 00000100:00100000:3.0:1788574176.049556:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646592 00000100:00100000:0.0:1788574176.049593:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646720 00000100:00100000:0.0:1788574176.049599:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646720 00000100:00100000:3.0:1788574176.049628:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:0.0:1788574176.049639:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:3.0:1788574176.049644:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727646592:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574176.049653:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727646720:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574176.049727:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727646720:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 70us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574176.049735:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00080000:0.0:1788574176.049756:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574176.049811:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646464 00000100:00100000:2.0:1788574176.049815:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646464 00000100:00100000:2.0:1788574176.049844:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 228 00000100:00100000:2.0:1788574176.049850:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727646464:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574176.064968:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727646592:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 15302us (15628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574176.064987:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:1.0:1788574176.070484:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574176.070590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574176.070596:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727646464:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 20738us (21225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574176.070610:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 228 00000100:00100000:2.0:1788574176.070784:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646848 00000100:00100000:2.0:1788574176.070794:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646848 00000100:00100000:2.0:1788574176.070908:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727646976 00000100:00100000:2.0:1788574176.070912:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727646976 00000100:00100000:2.0:1788574176.070939:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788574176.070949:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2352:x1875455727646848:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:2.0:1788574176.070975:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53599d 00000100:00080000:2.0:1788574176.070984:0:6712:0:(import.c:65:import_set_state_nolock()) ffff90a681297800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574176.071032:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788574176.071418:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+2:2352:x1875455727646848:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 470us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574176.071427:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788574176.072175:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788574176.072199:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2352:x1875455727646976:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:0.0:1788574176.072220:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5359a4 00000100:00080000:0.0:1788574176.072233:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2ed800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574176.072267:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788574176.072670:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574176.072886:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574176.072892:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788574176.073271:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574176.073496:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+2:2352:x1875455727646976:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 1306us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574176.073507:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00010000:00010000:2.0:1788574176.580460:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574177.408772:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747604224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574177.408852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574177.408911:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747604736:0@lo:400:kworker.0 00000100:00100000:0.0:1788574177.408940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574177.408974:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574177.408982:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747604352:0@lo:400:kworker.0 00000100:00100000:0.0:1788574177.409025:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574177.409069:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604224 00000100:00100000:0.0:1788574177.409078:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604224 00000100:00100000:0.0:1788574177.409119:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604352 00000100:00100000:0.0:1788574177.409122:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604352 00000100:00100000:0.0:1788574177.409165:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574177.409183:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747604224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574177.409447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747604480:0@lo:400:kworker.0 00000100:00100000:3.0:1788574177.409479:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574177.409506:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788574177.409513:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747604096:0@lo:400:kworker.0 00000100:00100000:3.0:1788574177.409540:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574177.409576:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747604608:0@lo:400:kworker.0 00000100:00100000:3.0:1788574177.409600:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574177.409624:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604608 00000100:00100000:3.0:1788574177.409628:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604608 00000100:00100000:3.0:1788574177.409653:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788574177.409661:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747604352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574177.409809:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747604224:12345-0@lo:400:kworker.0 Request processed in 627us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574177.409817:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574177.409835:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788574177.409841:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747604608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574177.409876:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747604608:12345-0@lo:400:kworker.0 Request processed in 35us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574177.409883:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788574177.409904:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604736 00000100:00100000:0.0:1788574177.409908:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604736 00000100:00100000:0.0:1788574177.409936:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604480 00000100:00100000:0.0:1788574177.409945:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604480 00000100:00100000:0.0:1788574177.409966:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788574177.409972:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747604736:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788574177.410723:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574177.410729:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574177.410732:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574177.411646:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604096 00000100:00100000:2.0:1788574177.411657:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604096 00000100:00100000:2.0:1788574177.411703:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788574177.411718:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747604096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574177.411786:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747604096:12345-0@lo:400:kworker.0 Request processed in 69us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574177.411793:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788574177.411832:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574177.411840:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747604480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574177.411872:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747604480:12345-0@lo:400:kworker.0 Request processed in 33us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574177.411878:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574177.411927:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747604096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574177.411944:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747604608:0@lo:400:kworker.0 00010000:00080000:2.0:1788574177.411958:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5d500 x1875455747604480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574177.411969:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747604480:0@lo:400:kworker.0 00000100:00100000:3.0:1788574177.418979:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747604352:12345-0@lo:400:kworker.0 Request processed in 9304us (9940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574177.418997:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788574177.420879:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747604736:12345-0@lo:400:kworker.0 Request processed in 10890us (11920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574177.420896:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574177.422110:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747604352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574177.422131:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747604224:0@lo:400:kworker.0 00010000:00080000:1.0:1788574177.422145:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791c5fb80 x1875455747604736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574177.422156:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747604736:0@lo:400:kworker.0 00010000:00010000:1.0:1788574177.600759:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574177.920679:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747604864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574177.920782:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574177.921010:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604864 00000100:00100000:2.0:1788574177.921020:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604864 00000100:00100000:2.0:1788574177.921085:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574177.921096:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747604864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574177.921142:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574177.921204:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747604864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574177.921211:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788574177.921414:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e6fd500 x1875455747604864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574177.921432:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747604864:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788574178.013712:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000020:00000080:1.0:1788574178.013722:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a7bb2e9000/bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000020:00000080:2.0:1788574178.013838:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2e9000/bbb204bb-74e4-44f7-ac26-18a0bfa744ec for lustre-OST0001 00000020:00000080:2.0:1788574178.013886:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7bb2ed800 for lustre-OST0001 00000001:00100000:3.0:1788574178.527551:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000020:00000080:3.0:1788574178.527563:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a681291800/bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000020:00000080:1.0:1788574178.527770:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a681291800/bbb204bb-74e4-44f7-ac26-18a0bfa744ec for lustre-OST0000 00000020:00000080:1.0:1788574178.527931:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a681297800 for lustre-OST0000 00010000:00010000:1.0:1788574178.629082:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574179.670417:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574180.482011:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747604992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574180.482088:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574180.482774:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747604992 00000100:00100000:0.0:1788574180.482784:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747604992 00000100:00100000:0.0:1788574180.482834:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574180.482843:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747604992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574180.482879:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574180.482932:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747604992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574180.482939:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788574180.482940:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574180.482978:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bbebdf80 x1875455747604992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574180.483008:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747604992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574180.673216:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574180.896041:0:11045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788574181.164208:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574181.164260:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574181.164305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574181.164577:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647104 00000100:00100000:2.0:1788574181.164589:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647104 00000100:00100000:3.0:1788574181.164637:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647360 00000100:00100000:3.0:1788574181.164641:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647360 00000100:00100000:2.0:1788574181.164644:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:2.0:1788574181.164655:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727647104:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574181.164682:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647232 00000100:00100000:3.0:1788574181.164684:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647232 00000100:00100000:3.0:1788574181.164704:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:3.0:1788574181.164710:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727647360:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574181.164733:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727647104:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 80us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574181.164739:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727647360:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574181.164745:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:2.0:1788574181.164755:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:3.0:1788574181.164765:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:3.0:1788574181.164771:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727647232:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574181.164801:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727647232:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574181.164807:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00080000:3.0:1788574181.164826:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574181.697138:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574182.529691:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747605504:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.529762:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.529828:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574182.529835:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747605120:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.529864:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.529883:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747605632:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.529918:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.529940:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747605376:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.529961:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.529980:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574182.529985:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747605248:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.530003:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.530017:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747605760:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.530035:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.530064:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605632 00000100:00100000:0.0:1788574182.530073:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605632 00000100:00100000:0.0:1788574182.530141:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605376 00000100:00100000:0.0:1788574182.530145:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605376 00000100:00100000:0.0:1788574182.530157:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605248 00000100:00100000:0.0:1788574182.530159:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605248 00000100:00100000:0.0:1788574182.530172:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788574182.530180:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747605632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.530231:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747605632:12345-0@lo:400:kworker.0 Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574182.530238:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788574182.530254:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788574182.530260:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747605376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.530308:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747605376:12345-0@lo:400:kworker.0 Request processed in 47us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574182.530314:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788574182.530326:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788574182.530332:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747605248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.530358:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747605248:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574182.530364:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574182.530847:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605504 00000100:00100000:2.0:1788574182.530853:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605504 00000100:00100000:2.0:1788574182.530878:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605760 00000100:00100000:2.0:1788574182.530881:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605760 00000100:00100000:2.0:1788574182.530900:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788574182.530906:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747605504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574182.530941:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747605504:12345-0@lo:400:kworker.0 Request processed in 36us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574182.530947:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788574182.530960:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574182.530965:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747605760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574182.530989:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747605760:12345-0@lo:400:kworker.0 Request processed in 23us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574182.530996:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574182.531013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605120 00000100:00100000:2.0:1788574182.531017:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605120 00000100:00100000:2.0:1788574182.531037:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788574182.531044:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747605120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574182.531071:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747605120:12345-0@lo:400:kworker.0 Request processed in 28us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574182.531097:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:0.0:1788574182.531332:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574182.531337:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574182.531340:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574182.540763:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747605120:0@lo:400:kworker.0 00000100:00100000:1.0:1788574182.540790:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747605632:0@lo:400:kworker.0 00010000:00080000:1.0:1788574182.540809:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7933baa00 x1875455747605504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574182.540820:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747605504:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.541570:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747605248:0@lo:400:kworker.0 00010000:00080000:0.0:1788574182.541589:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7933b8700 x1875455747605760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574182.541600:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747605760:0@lo:400:kworker.0 00000100:00100000:0.0:1788574182.541625:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747605376:0@lo:400:kworker.0 00010000:00010000:3.0:1788574182.721735:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574183.043296:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747605888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574183.043428:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574183.043582:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747605888 00000100:00100000:3.0:1788574183.043593:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747605888 00000100:00100000:3.0:1788574183.043746:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574183.043757:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747605888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574183.043804:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574183.044422:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747605888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 666us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574183.044431:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788574183.047559:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bbebf800 x1875455747605888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574183.047592:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747605888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788574183.744628:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574184.553904:0:11194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddb021330 20000000:00000080:3.0:1788574184.553923:0:11194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7bfb05000 uarg=0000000000000000 20000000:01000000:3.0:1788574184.554020:0:11194:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574184.554026:0:11194:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574184.554031:0:11194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788574184.554968:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788574184.555233:0:11194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788574184.560819:0:11194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788574184.560850:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560869:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535950 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560878:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560885:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53596c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560894:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560901:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560923:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560970:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.560987:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 12 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.561002:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606016:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574184.561214:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561223:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 12 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.561232:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606144:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574184.561259:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53596c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561267:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53596c expref: 18 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.561276:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606272:0@lo:104: 00000100:00100000:3.0:1788574184.561312:0:11194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574184.561348:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561400:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.561411:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606400:0@lo:104: 00000100:00100000:3.0:1788574184.561433:0:11194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574184.561466:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747606272 00000100:00100000:3.0:1788574184.561474:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747606272 00000100:00100000:3.0:1788574184.561514:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747606400 00000100:00100000:3.0:1788574184.561516:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747606400 00000100:00100000:3.0:1788574184.561528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574184.561537:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+4:11194:x1875455747606272:12345-0@lo:104: 00010000:00010000:3.0:1788574184.561550:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561607:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574184.561613:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+4:11194:x1875455747606272:12345-0@lo:104: Request processed in 77us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574184.561620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574184.561637:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574184.561642:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:11194:x1875455747606400:12345-0@lo:104: 00010000:00010000:3.0:1788574184.561649:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561675:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574184.561679:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:11194:x1875455747606400:12345-0@lo:104: Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574184.561684:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788574184.561705:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574184.561710:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561717:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574184.561721:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561730:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574184.561736:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574184.561743:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574184.561766:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561772:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574184.561793:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561800:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b53596c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535973 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561813:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574184.561816:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561821:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574184.561824:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561835:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574184.561842:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574184.561847:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574184.561857:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561861:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574184.561866:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561872:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b53595e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561880:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574184.561882:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574184.561883:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574184.561900:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b535950 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.561908:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b535950 expref: 18 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.561916:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606784:0@lo:104: 00000100:00100000:3.0:1788574184.561936:0:11194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574184.561954:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747606784 00000100:00100000:3.0:1788574184.561968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747606784 00000100:00100000:3.0:1788574184.561988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574184.561993:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:11194:x1875455747606784:12345-0@lo:104: 00010000:00010000:3.0:1788574184.562000:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.562031:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574184.562036:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a547233-5b7a-4801-b1c0-26875afe1265+3:11194:x1875455747606784:12345-0@lo:104: Request processed in 44us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574184.562040:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574184.562080:0:11194:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574184.562105:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606272:0@lo:104: 00000100:00100000:3.0:1788574184.562112:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606400:0@lo:104: 00000100:00100000:3.0:1788574184.562118:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606784:0@lo:104: 00000100:00100000:0.0:1788574184.562550:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747606528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574184.562599:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574184.562636:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574184.562641:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747606656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574184.562660:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574184.562678:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574184.562683:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562690:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574184.562694:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562703:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574184.562710:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574184.562715:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788574184.562733:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562739:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574184.562753:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562760:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b535950 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b535957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562773:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574184.562774:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574184.562776:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574184.562791:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747606528 00000100:00100000:0.0:1788574184.562796:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747606528 00010000:00010000:0.0:1788574184.562818:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53596c expref: 19 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574184.562837:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747606656 00000100:00100000:0.0:1788574184.562839:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747606656 00010000:00010000:0.0:1788574184.562847:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53595e expref: 20 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574184.562858:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574184.562863:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79260b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+20:3314:x1875455747606528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574184.562872:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574184.562877:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53596c expref: 20 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562886:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53596c expref: 20 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562898:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4d800/0x10531a153b535973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53596c expref: 20 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.562910:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574184.562936:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79260b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747606528:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574184.562943:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574184.562977:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574184.562983:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+18:3314:x1875455747606656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574184.562989:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574184.562993:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.563006:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.563016:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21400/0x10531a153b535965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53595e expref: 18 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.563024:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574184.563059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+17:3314:x1875455747606656:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574184.563187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574184.563212:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747606912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574184.563237:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574184.563269:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747606912 00000100:00100000:0.0:1788574184.563273:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747606912 00010000:00010000:0.0:1788574184.563286:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535950 expref: 17 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574184.563301:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574184.563307:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+17:3312:x1875455747606912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574184.563314:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574184.563318:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b535950 expref: 17 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.563325:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b535950 expref: 17 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.563336:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21200/0x10531a153b535957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b535950 expref: 17 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574184.563355:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574184.563399:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+16:3312:x1875455747606912:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574184.563405:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574184.563435:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747606912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574184.563458:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747606656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574184.563465:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747606528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574184.563504:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574184.567215:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574184.567256:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574184.567339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647616 00000100:00100000:2.0:1788574184.567350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647616 00010000:00010000:2.0:1788574184.567418:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 13 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574184.567451:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647488 00000100:00100000:2.0:1788574184.567455:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647488 00010000:00010000:2.0:1788574184.567469:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 14 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574184.567484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:2.0:1788574184.567493:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec16a69b-cbad-484e-9f31-b00eca338977+14:2355:x1875455727647616:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574184.567507:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574184.567513:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 14 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567526:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 14 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567550:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574184.567615:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec16a69b-cbad-484e-9f31-b00eca338977+14:2355:x1875455727647616:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 122us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574184.567624:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:2.0:1788574184.567643:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:2.0:1788574184.567650:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727647488:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574184.567657:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574184.567677:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 13 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567686:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 13 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567699:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567707:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567722:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567729:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567736:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567742:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567747:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574184.567752:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567760:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567768:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574184.567786:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574184.567806:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727647488:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 156us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574184.567812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00010000:00010000:3.0:1788574184.570833:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a000/0x10531a153b53598f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3719 expref: 12 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.570854:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606016:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574184.570869:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b800/0x10531a153b53597a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e1 expref: 11 pid: 5852 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574184.570879:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875455747606144:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574184.571144:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.571159:0:11194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.571190:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.571197:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b600/0x10531a153b5359ab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574184.774516:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574185.600665:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574185.604410:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747607040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574185.604491:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574185.604742:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607040 00000100:00100000:1.0:1788574185.604751:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607040 00000100:00100000:1.0:1788574185.604821:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574185.604831:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747607040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574185.604879:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574185.604938:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747607040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574185.604946:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788574185.605108:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574185.605183:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8ece00 x1875455747607040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574185.605203:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747607040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574185.794676:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574186.285256:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574186.285319:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574186.285352:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647744 00000100:00100000:2.0:1788574186.285362:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647744 00000100:00100000:2.0:1788574186.285428:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:2.0:1788574186.285439:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:2354:x1875455727647744:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574186.285511:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:2354:x1875455727647744:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 74us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574186.285520:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:2.0:1788574186.285553:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727647872 00000100:00100000:2.0:1788574186.285557:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727647872 00000100:00100000:2.0:1788574186.285597:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:2.0:1788574186.285605:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727647872:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574186.285647:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727647872:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574186.285661:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00080000:2.0:1788574186.285794:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574186.294881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574186.295667:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648000 00000100:00100000:1.0:1788574186.295677:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648000 00000100:00100000:1.0:1788574186.295753:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:1.0:1788574186.295765:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727648000:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574186.295857:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727648000:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 93us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574186.295867:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00080000:1.0:1788574186.295908:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788574186.304865:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574186.304875:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6812f6000 from 7 10000000:01000000:0.0:1788574186.304881:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574186.304931:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.304944:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.304955:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574186.304983:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.305072:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.305124:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574186.309096:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607168 00000100:00100000:2.0:1788574186.309115:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607168 00000100:00100000:2.0:1788574186.309174:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788574186.309186:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747607168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574186.309203:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574186.309227:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5359b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574186.309258:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5359b2 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574186.309270:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5359b2 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574186.309280:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984600, rc 0) 00000100:00100000:2.0:1788574186.309387:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747607168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574186.309396:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788574186.313067:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574186.313107:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.313120:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574186.313221:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.313300:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.313351:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.313357:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607296 00000100:00100000:3.0:1788574186.313393:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607296 00000100:00100000:3.0:1788574186.313458:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788574186.313470:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747607296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.314129:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747607296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 659us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.314139:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788574186.315213:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.315295:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.315361:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.315423:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.315762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607424 00000100:00100000:3.0:1788574186.315771:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607424 00000100:00100000:3.0:1788574186.315834:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788574186.315845:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747607424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.316087:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747607424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.316096:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788574186.316100:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574186.321459:0:11272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788574186.323774:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788574186.323811:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574186.323824:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.323839:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574186.323850:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574186.323853:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a785e1b800 from 7 10000000:01000000:0.0:1788574186.323856:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574186.323895:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.323911:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.323924:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574186.323955:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.324039:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.324084:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.324192:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607552 00000100:00100000:3.0:1788574186.324201:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607552 00000100:00100000:3.0:1788574186.324262:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788574186.324271:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747607552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574186.324295:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574186.324310:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5359c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.324341:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5359c0 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.324352:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5359c0 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.324361:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a400, rc 0) 00000100:00100000:3.0:1788574186.324424:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747607552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.324432:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788574186.324528:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574186.324543:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.324553:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574186.324609:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.324650:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.324678:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.324780:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607680 00000100:00100000:3.0:1788574186.324785:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607680 00000100:00100000:3.0:1788574186.324813:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788574186.324819:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747607680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.325077:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747607680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.325085:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788574186.325489:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.325523:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.325563:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.325593:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.325643:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607808 00000100:00100000:3.0:1788574186.325649:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607808 00000100:00100000:3.0:1788574186.325677:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788574186.325684:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747607808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.325850:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747607808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.325865:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788574186.326002:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574186.327246:0:11273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788574186.327746:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788574186.327776:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574186.327787:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.327799:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574186.327811:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574186.327813:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a790a3d000 from 7 10000000:01000000:0.0:1788574186.327817:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574186.327851:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.327860:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.327871:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574186.327895:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.327953:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.327995:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.329444:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747607936 00000100:00100000:3.0:1788574186.329458:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747607936 00000100:00100000:3.0:1788574186.329511:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788574186.329523:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747607936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574186.329545:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574186.329571:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5359ce expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.329605:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5359ce expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.330713:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5359ce expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.330729:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b600, rc 0) 00000100:00100000:3.0:1788574186.330807:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747607936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1287us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.330815:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788574186.331483:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747607936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574186.331508:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.331521:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574186.331605:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747608064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.331735:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.331768:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574186.332482:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608064 00000100:00100000:3.0:1788574186.332491:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608064 00000100:00100000:3.0:1788574186.332532:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788574186.332541:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747608064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.333241:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747608064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 697us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.333249:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788574186.334506:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747608064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.334568:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747608192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.334637:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574186.334672:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574186.334688:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608192 00000100:00100000:0.0:1788574186.334694:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608192 00000100:00100000:0.0:1788574186.334730:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788574186.334737:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747608192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.334906:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747608192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574186.334913:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788574186.334951:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747608192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788574186.338904:0:11274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788574186.343918:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788574186.343952:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574186.343963:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.343976:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574186.481979:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574186.486717:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648128 00000100:00100000:3.0:1788574186.486732:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648128 00000100:00100000:3.0:1788574186.486843:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 242 00000100:00100000:3.0:1788574186.486855:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+11:5596:x1875455727648128:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574186.486873:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574186.486891:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3743 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.486920:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.486931:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574186.486940:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b800, rc 0) 00000100:00100000:3.0:1788574186.487001:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727648128:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 147us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.487007:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 242 00000100:00100000:0.0:1788574186.501542:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574186.501579:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648256 00000100:00100000:0.0:1788574186.501590:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648256 00000100:00100000:0.0:1788574186.501653:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 243 00000100:00100000:0.0:1788574186.501665:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727648256:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574186.502182:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727648256:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 518us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574186.502191:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 243 00000100:00100000:1.0:1788574186.508989:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574186.510105:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648384 00000100:00100000:3.0:1788574186.510118:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648384 00000100:00100000:3.0:1788574186.510173:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 244 00000100:00100000:3.0:1788574186.510193:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727648384:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.515971:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727648384:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 5767us (6980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.515985:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 244 00000100:00100000:2.0:1788574186.526718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574186.526799:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648512 00000100:00100000:0.0:1788574186.526809:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648512 00000100:00100000:0.0:1788574186.526896:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 245 00000100:00100000:0.0:1788574186.526917:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727648512:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574186.526938:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574186.526960:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce374a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.526992:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.527005:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574186.527026:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ce00, rc 0) 00000100:00100000:0.0:1788574186.527094:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727648512:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 179us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574186.527102:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 245 00000100:00100000:3.0:1788574186.536395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574186.536441:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648640 00000100:00100000:3.0:1788574186.536450:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648640 00000100:00100000:3.0:1788574186.536499:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 246 00000100:00100000:3.0:1788574186.536509:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727648640:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.536841:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727648640:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 332us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.536848:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 246 00000100:00100000:3.0:1788574186.540394:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574186.540429:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648768 00000100:00100000:3.0:1788574186.540438:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648768 00000100:00100000:3.0:1788574186.540487:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 247 00000100:00100000:3.0:1788574186.540496:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727648768:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574186.540711:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727648768:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 215us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574186.540720:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 247 00010000:00010000:0.0:1788574186.816694:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574187.648663:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747608704:0@lo:400:kworker.0 00000100:00100000:0.0:1788574187.648744:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574187.648804:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574187.648812:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747608576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574187.648839:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574187.648981:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747608320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649046:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574187.649079:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747608832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649102:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574187.649120:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788574187.649125:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747608448:0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649143:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574187.649157:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747608960:0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649173:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574187.649198:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608576 00000100:00100000:1.0:1788574187.649204:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608576 00000100:00100000:1.0:1788574187.649248:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608832 00000100:00100000:1.0:1788574187.649251:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608832 00000100:00100000:1.0:1788574187.649262:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608448 00000100:00100000:1.0:1788574187.649264:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608448 00000100:00100000:1.0:1788574187.649276:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788574187.649284:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747608576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649334:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747608576:12345-0@lo:400:kworker.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574187.649341:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788574187.649397:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788574187.649404:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747608832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649447:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747608832:12345-0@lo:400:kworker.0 Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574187.649454:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788574187.649466:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788574187.649472:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747608448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649499:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747608448:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574187.649505:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1788574187.649522:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574187.649555:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747608448:0@lo:400:kworker.0 00000100:00100000:1.0:1788574187.649565:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747608832:0@lo:400:kworker.0 00000100:00100000:2.0:1788574187.649806:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608704 00000100:00100000:2.0:1788574187.649812:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608704 00000100:00100000:2.0:1788574187.649847:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608960 00000100:00100000:2.0:1788574187.649851:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608960 00000100:00100000:2.0:1788574187.649871:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574187.649878:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747608704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574187.649924:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747608704:12345-0@lo:400:kworker.0 Request processed in 47us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574187.649931:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574187.649944:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788574187.649950:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747608960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574187.649981:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747608960:12345-0@lo:400:kworker.0 Request processed in 31us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574187.649987:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788574187.650032:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574187.650035:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574187.654267:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747608320 00000100:00100000:0.0:1788574187.654286:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747608320 00000100:00100000:0.0:1788574187.654364:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788574187.654393:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747608320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574187.654506:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747608320:12345-0@lo:400:kworker.0 Request processed in 116us (5474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574187.654531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788574187.654625:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747608576:0@lo:400:kworker.0 00010000:00080000:0.0:1788574187.654644:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7933bb480 x1875455747608704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574187.654655:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747608704:0@lo:400:kworker.0 00010000:00080000:2.0:1788574187.654859:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7926b0700 x1875455747608960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574187.654870:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747608960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574187.654881:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747608320:0@lo:400:kworker.0 00010000:00010000:0.0:1788574187.841746:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574188.065141:0:11390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788574188.161338:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747609088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574188.161446:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574188.161806:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609088 00000100:00100000:3.0:1788574188.161814:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609088 00000100:00100000:3.0:1788574188.161866:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788574188.161876:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747609088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574188.161923:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574188.161968:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747609088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574188.161976:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788574188.162098:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8efb80 x1875455747609088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574188.162120:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747609088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788574188.872063:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574189.888764:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574190.720795:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574190.720971:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747609216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574190.721049:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574190.721557:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609216 00000100:00100000:3.0:1788574190.721567:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609216 00000100:00100000:3.0:1788574190.721674:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574190.721685:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747609216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574190.721721:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574190.721785:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747609216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.721792:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788574190.721971:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e8efb80 x1875455747609216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574190.722003:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747609216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788574190.722336:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574190.914073:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574191.379032:0:11492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:09:50 (1788574190) === 00000100:00100000:0.0:1788574191.410663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574191.410698:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574191.410717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574191.410744:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727649024 00000100:00100000:0.0:1788574191.410754:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727649024 00000100:00100000:0.0:1788574191.410983:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727649152 00000100:00100000:0.0:1788574191.410986:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727649152 00000100:00100000:0.0:1788574191.411012:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:0.0:1788574191.411020:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727649024:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574191.411089:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727649024:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 69us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574191.411096:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:0.0:1788574191.411112:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:0.0:1788574191.411117:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727649152:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574191.411134:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727649152:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 17us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574191.411138:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:0.0:1788574191.411164:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727648896 00000100:00100000:0.0:1788574191.411167:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727648896 00000100:00100000:0.0:1788574191.411187:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 249 00000100:00100000:0.0:1788574191.411191:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727648896:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574191.411212:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727648896:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 20us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574191.411216:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 249 00000100:00080000:0.0:1788574191.411241:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574191.766755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574191.766838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574191.766938:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727649280 00000100:00100000:0.0:1788574191.766948:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727649280 00000100:00100000:0.0:1788574191.767012:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788574191.767022:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727649280:12345-192.168.201.57@tcp:41:mkdir.0 00000004:00000024:0.0:1788574191.767069:0:5859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788574191.767171:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727649280:12345-192.168.201.57@tcp:41:mkdir.0 Request processed in 150us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574191.767179:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788574191.767669:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727649408 00000100:00100000:3.0:1788574191.767676:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727649408 00000100:00100000:3.0:1788574191.767712:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574191.767719:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:9673:x1875455727649408:12345-192.168.201.57@tcp:700:mkdir.0 00000100:00100000:3.0:1788574191.767760:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:9673:x1875455727649408:12345-192.168.201.57@tcp:700:mkdir.0 Request processed in 41us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574191.767767:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788574191.771654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574191.771756:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727649664 00000100:00100000:0.0:1788574191.771767:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727649664 00000100:00100000:0.0:1788574191.771828:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788574191.771839:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:9673:x1875455727649664:12345-192.168.201.57@tcp:36:mkdir.0 00010000:00010000:0.0:1788574191.771895:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574191.771920:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b5358cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36cc expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.771964:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70600) 00010000:00010000:0.0:1788574191.771975:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574191.772283:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.772297:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.772307:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.772348:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.772356:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.772363:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574191.773574:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788574191.773590:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.773599:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.773605:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.773612:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574191.773616:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.773624:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.773644:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544f800) 00010000:00010000:0.0:1788574191.773646:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574191.773651:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574191.773658:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5359ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574191.773676:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d86a2201 reply state 000000008b7d4d86 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574191.773685:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574191.775526:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9673:x1875455727649664:12345-192.168.201.57@tcp:36:mkdir.0 Request processed in 3675us (3867us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788574191.775539:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00010000:00010000:1.0:1788574191.780098:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.780116:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.780123:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.780128:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574191.780147:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.780156:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.780180:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a78544fa00) 00010000:00010000:1.0:1788574191.780184:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574191.780189:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.780196:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5359f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574191.800291:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574191.800841:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727649792 00000100:00100000:0.0:1788574191.800854:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727649792 00000100:00100000:2.0:1788574191.809316:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788574191.809331:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:9675:x1875455727649792:12345-192.168.201.57@tcp:101:chmod.0 00010000:00010000:2.0:1788574191.809353:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574191.809390:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5359f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3751 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574191.809472:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5359ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574191.809486:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5359ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574191.809499:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5359ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574191.809810:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788574191.809815:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574191.809895:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5359ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574191.809933:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5359f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3751 expref: 8 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574191.809954:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5359ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3751 expref: 7 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574191.809982:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70200) 00010000:00010000:2.0:1788574191.809985:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574191.809990:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985c00, rc 0) 00000100:00100000:2.0:1788574191.810128:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9675:x1875455727649792:12345-192.168.201.57@tcp:101:chmod.0 Request processed in 799us (9845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574191.810136:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788574191.819848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574191.819996:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727650048 00000100:00100000:3.0:1788574191.820006:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727650048 00000100:00100000:3.0:1788574191.820066:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574191.820077:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9675:x1875455727650048:12345-192.168.201.57@tcp:36:chmod.0 00010000:00010000:3.0:1788574191.820134:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574191.820161:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5359ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3751 expref: 7 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.820202:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70200) 00010000:00010000:3.0:1788574191.820214:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574191.820244:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.820421:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.820434:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574191.821542:0:10109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7e649fc reply state 0000000067203190 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574191.821557:0:10109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788574191.821567:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788574191.821663:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:9675:x1875455727650048:12345-192.168.201.57@tcp:36:chmod.0 Request processed in 1584us (1822us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788574191.821671:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00010000:00010000:1.0:1788574191.827681:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.827705:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.827715:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.827722:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574191.827728:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.827736:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.827758:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37500) 00010000:00010000:1.0:1788574191.827761:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788574191.827782:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.827802:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a06 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574191.856013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574191.856116:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727650176 00000100:00100000:1.0:1788574191.856128:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727650176 00000100:00100000:1.0:1788574191.856203:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:1.0:1788574191.856213:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9676:x1875455727650176:12345-192.168.201.57@tcp:101:chown.0 00010000:00010000:1.0:1788574191.856238:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574191.856274:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3758 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.856338:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535a14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.856351:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.856362:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574191.856437:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788574191.856441:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574191.856482:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.856521:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3758 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.856542:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3758 expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.856564:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7b2398200) 00010000:00010000:1.0:1788574191.856567:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574191.856571:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574191.856644:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:9676:x1875455727650176:12345-192.168.201.57@tcp:101:chown.0 Request processed in 431us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574191.856651:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788574191.867712:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574191.867802:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727650304 00000100:00100000:3.0:1788574191.867812:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727650304 00000100:00100000:3.0:1788574191.867864:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788574191.867873:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:9676:x1875455727650304:12345-192.168.201.57@tcp:101:chown.0 00010000:00010000:3.0:1788574191.867893:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574191.867913:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce375f expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.867993:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868022:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868035:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868052:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868060:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868066:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868153:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868160:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868167:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574191.868208:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574191.868212:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574191.868234:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868246:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868268:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868274:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868279:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574191.868284:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868291:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868310:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7b2398200) 00010000:00010000:3.0:1788574191.868312:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574191.868317:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868322:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868335:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868340:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868345:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868349:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574191.868356:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868362:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868417:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a784e37900) 00010000:00010000:3.0:1788574191.868420:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574191.868422:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868428:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535a29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868459:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce375f expref: 10 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868471:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce375f expref: 9 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.868478:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37600) 00010000:00010000:3.0:1788574191.868481:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574191.868483:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780031600, rc 0) 00000100:00100000:3.0:1788574191.868542:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:9676:x1875455727650304:12345-192.168.201.57@tcp:101:chown.0 Request processed in 669us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574191.868550:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788574191.877071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574191.877172:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727650560 00000100:00100000:1.0:1788574191.877182:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727650560 00000100:00100000:1.0:1788574191.877257:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:1.0:1788574191.877267:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:9676:x1875455727650560:12345-192.168.201.57@tcp:36:chown.0 00010000:00010000:1.0:1788574191.877326:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574191.877353:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce375f expref: 9 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.877414:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37600) 00010000:00010000:1.0:1788574191.877425:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574191.877451:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.877639:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.877652:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.938491:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788574191.953821:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1788574191.953838:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788574191.954917:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e82bdfdc reply state 00000000bc4c973c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574191.954951:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788574191.954967:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788574191.955082:0:5858:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788574191.955106:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9676:x1875455727650560:12345-192.168.201.57@tcp:36:chown.0 Request processed in 77835us (78039us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788574191.955114:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00010000:00010000:1.0:1788574191.955468:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.955494:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.955502:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.955518:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574191.955523:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.955531:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.955546:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a7b2398800) 00010000:00010000:1.0:1788574191.955549:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788574191.955554:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.955560:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574191.971250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574191.971416:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727650688 00000100:00100000:2.0:1788574191.971426:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727650688 00000100:00100000:2.0:1788574191.971487:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:2.0:1788574191.971498:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:9677:x1875455727650688:12345-192.168.201.57@tcp:101:touch.500 00010000:00010000:2.0:1788574191.971524:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574191.971546:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3766 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574191.974342:0:10109:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2737us 00010000:00010000:3.0:1788574191.993201:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993225:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993238:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993251:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993257:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993262:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993597:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993607:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993614:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574191.993635:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574191.993639:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574191.993672:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993682:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993694:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993701:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993707:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574191.993712:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993720:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993731:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7b2398200) 00010000:00010000:3.0:1788574191.993735:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574191.993740:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993746:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031a00/0x10531a153b535a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993758:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993765:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993770:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993775:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574191.993784:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993790:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993798:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a784e37900) 00010000:00010000:3.0:1788574191.993801:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574191.993804:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993809:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535a4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993845:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3766 expref: 8 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993861:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3766 expref: 7 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574191.993868:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574191.993870:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788574191.993872:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780031400, rc 0) 00000100:00100000:3.0:1788574191.993953:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9677:x1875455727650688:12345-192.168.201.57@tcp:101:touch.500 Request processed in 22456us (22714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574191.993961:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788574191.998822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574191.998908:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727650944 00000100:00100000:1.0:1788574191.998932:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727650944 00000100:00100000:1.0:1788574191.999066:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788574191.999077:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9677:x1875455727650944:12345-192.168.201.57@tcp:101:touch.500 00010000:00010000:1.0:1788574191.999098:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574191.999117:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce376d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.999643:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.999665:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.999677:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.999737:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.999745:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574191.999752:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574192.014259:0:5859:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788574192.017294:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b535a6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.017317:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b535a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018581:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b535a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018650:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018657:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018664:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018685:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574192.018690:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018697:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018711:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:1.0:1788574192.018714:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574192.018718:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018724:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535a61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574192.018739:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016ac87f5 reply state 00000000de884b68 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574192.018747:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788574192.018788:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535a5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce376d expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018803:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b535a6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce376d expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.018810:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a7b2398300) 00010000:00010000:1.0:1788574192.018812:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574192.018814:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21200, rc 0) 00000100:00100000:1.0:1788574192.018908:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:9677:x1875455727650944:12345-192.168.201.57@tcp:101:touch.500 Request processed in 19833us (20095us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788574192.018937:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00010000:00010000:1.0:1788574192.024976:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.024996:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.025005:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.025011:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574192.025016:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.025024:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.025042:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff90a7b2398800) 00010000:00010000:1.0:1788574192.025045:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574192.025050:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.025055:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535a68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574192.039083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.039699:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727651200 00000100:00100000:0.0:1788574192.039711:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727651200 00000100:00100000:0.0:1788574192.039770:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788574192.039793:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:9677:x1875455727651200:12345-192.168.201.57@tcp:36:touch.500 00010000:00010000:0.0:1788574192.039864:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574192.039891:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b535a6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce376d expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.039912:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a7b2398300) 00010000:00010000:0.0:1788574192.039932:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574192.039985:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.039999:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.040009:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574192.040150:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b67d841 reply state 000000008d18dbd3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574192.040160:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574192.040265:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:9677:x1875455727651200:12345-192.168.201.57@tcp:36:touch.500 Request processed in 485us (1194us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788574192.040272:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00010000:00010000:1.0:1788574192.043090:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.043110:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.043138:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.043144:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574192.043148:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.043156:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.043172:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a78544f400) 00010000:00010000:1.0:1788574192.043175:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574192.043179:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.043186:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574192.044989:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.045574:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727651328 00000100:00100000:0.0:1788574192.045585:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727651328 00000100:00100000:0.0:1788574192.045640:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:0.0:1788574192.045650:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:9677:x1875455727651328:12345-192.168.201.57@tcp:101:touch.500 00010000:00010000:0.0:1788574192.045673:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574192.045696:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535a84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3774 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.045778:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535a84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3774 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.045808:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535a84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3774 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.046112:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a78544f800) 00010000:00010000:0.0:1788574192.046116:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574192.046120:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c000, rc 0) 00000100:00100000:0.0:1788574192.046186:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:9677:x1875455727651328:12345-192.168.201.57@tcp:101:touch.500 Request processed in 537us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.046194:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:2.0:1788574192.054185:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.054404:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727651456 00000100:00100000:0.0:1788574192.054415:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727651456 00000100:00100000:2.0:1788574192.054598:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788574192.054608:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875455727651456:12345-192.168.201.57@tcp:8:touch.500 00010000:00080000:2.0:1788574192.054649:0:6713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1788574192.054684:0:6713:0:(genops.c:1385:class_connect()) connect: client f540d78c-33c0-4206-a4f5-51879daa7a3f, cookie 0x10531a153b535a8b 00002000:00100000:2.0:1788574192.054698:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f540d78c-33c0-4206-a4f5-51879daa7a3f/ffff90a785f01800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574192.054738:0:6713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574192.055141:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574192.055173:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a785f07800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574192.055246:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2352:x1875455727651456:12345-192.168.201.57@tcp:8:touch.500 Request processed in 637us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574192.055254:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788574192.060713:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.061131:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727651584 00000100:00100000:0.0:1788574192.061142:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727651584 00000100:00100000:0.0:1788574192.061222:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788574192.061233:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:0:x1875455727651584:12345-192.168.201.57@tcp:2:touch.500 00000100:00080000:2.0:1788574192.061856:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574192.203749:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:0:x1875455727651584:12345-192.168.201.57@tcp:2:touch.500 Request processed in 142507us (143034us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788574192.203762:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000001:00080000:3.0:1788574192.204108:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1788574192.204136:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000100:00100000:3.0:1788574192.207620:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574192.207774:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727651840 00000100:00100000:1.0:1788574192.207794:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727651840 00000100:00100000:1.0:1788574192.207855:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:1.0:1788574192.207865:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:9677:x1875455727651840:12345-192.168.201.57@tcp:35:touch.500 00000100:00100000:1.0:1788574192.208660:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:9677:x1875455727651840:12345-192.168.201.57@tcp:35:touch.500 Request processed in 792us (1044us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788574192.208670:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574192.255219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.255494:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727651968 00000100:00100000:0.0:1788574192.255505:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727651968 00000100:00100000:0.0:1788574192.255571:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:0.0:1788574192.255581:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:9678:x1875455727651968:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:0.0:1788574192.255604:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574192.255628:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce377b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.255718:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535a99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.255732:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.255744:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574192.255778:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574192.255782:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574192.255818:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.255846:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce377b expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.255866:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce377b expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.255876:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574192.255879:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574192.255884:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574192.256857:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:9678:x1875455727651968:12345-192.168.201.57@tcp:101:rm.0 Request processed in 1269us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.256867:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788574192.271134:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574192.271803:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727652224 00000100:00100000:1.0:1788574192.271815:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727652224 00000100:00100000:1.0:1788574192.271935:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:1.0:1788574192.271956:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:9678:x1875455727652224:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:1.0:1788574192.271985:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574192.272008:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3782 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574192.272104:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788574192.272278:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aa0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3782 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.272292:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7b2398200) 00010000:00010000:1.0:1788574192.272295:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574192.272301:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3782 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.272317:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21400, rc 0) 00000100:00100000:1.0:1788574192.273023:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:9678:x1875455727652224:12345-192.168.201.57@tcp:101:rm.0 Request processed in 1067us (1895us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788574192.273032:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:0.0:1788574192.282231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574192.282352:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727652352 00000100:00100000:3.0:1788574192.282363:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727652352 00000100:00100000:3.0:1788574192.282466:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:3.0:1788574192.282478:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:9678:x1875455727652352:12345-192.168.201.57@tcp:37:rm.0 00000100:00100000:0.0:1788574192.297199:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:9678:x1875455727652352:12345-192.168.201.57@tcp:37:rm.0 Request processed in 14710us (14965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.297230:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:3.0:1788574192.309761:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574192.309870:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727652608 00000100:00100000:2.0:1788574192.309880:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727652608 00000100:00100000:2.0:1788574192.309956:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574192.309976:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785620450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:9678:x1875455727652608:12345-192.168.201.57@tcp:35:rm.0 00000100:00100000:2.0:1788574192.310214:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785620450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:9678:x1875455727652608:12345-192.168.201.57@tcp:35:rm.0 Request processed in 239us (461us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788574192.310222:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788574192.314473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574192.314625:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727652864 00000100:00100000:2.0:1788574192.314637:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727652864 00000100:00100000:2.0:1788574192.314694:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788574192.314705:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:9678:x1875455727652864:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:2.0:1788574192.314733:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574192.314759:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3789 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.314870:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535ab5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.314901:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.314924:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574192.314937:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788574192.315077:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3789 expref: 17 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.315095:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3789 expref: 16 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.315105:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:2.0:1788574192.315108:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574192.315111:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574192.315179:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727652864:12345-192.168.201.57@tcp:101:rm.0 Request processed in 476us (717us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788574192.315187:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:3.0:1788574192.322725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.322981:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727652992 00000100:00100000:0.0:1788574192.322992:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727652992 00000100:00100000:0.0:1788574192.323054:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:0.0:1788574192.323066:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727652992:12345-192.168.201.57@tcp:41:rm.0 00000004:00000024:0.0:1788574192.323132:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788574192.323211:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727652992:12345-192.168.201.57@tcp:41:rm.0 Request processed in 148us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.323220:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788574192.327142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574192.327335:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727653120 00000100:00100000:2.0:1788574192.327347:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727653120 00000100:00100000:2.0:1788574192.327443:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:2.0:1788574192.327464:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727653120:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:2.0:1788574192.327486:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574192.327508:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535ac3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3790 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327597:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327614:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327626:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327641:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327648:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327656:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327756:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327765:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327771:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574192.327797:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788574192.327801:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574192.327819:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327843:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327853:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327861:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327868:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327875:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574192.327880:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327888:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327900:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:2.0:1788574192.327903:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574192.327908:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327935:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b535aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.327952:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328193:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328207:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328211:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574192.328214:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328220:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328229:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff90a782d70900) 00010000:00010000:2.0:1788574192.328232:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574192.328235:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328240:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328276:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535ac3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3790 expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328290:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3790 expref: 17 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.328297:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a78544f800) 00010000:00010000:2.0:1788574192.328299:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574192.328302:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984e00, rc 0) 00000100:00100000:2.0:1788574192.332112:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:9678:x1875455727653120:12345-192.168.201.57@tcp:101:rm.0 Request processed in 4632us (4962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574192.332146:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:3.0:1788574192.346721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.347091:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727653376 00000100:00100000:0.0:1788574192.347101:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727653376 00000100:00100000:0.0:1788574192.347173:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:0.0:1788574192.347184:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:9678:x1875455727653376:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:0.0:1788574192.347241:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788574192.347269:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3790 expref: 17 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347293:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535a84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3774 expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347305:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a78544f800) 00010000:00010000:0.0:1788574192.347320:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535a99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce377b expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347623:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574192.347640:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574192.347665:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347679:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347690:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347704:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347712:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.347718:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.348299:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.348310:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.348318:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574192.351241:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788574192.351257:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318525888599ns, next at 319525885172ns, rc = 0 00010000:00010000:1.0:1788574192.352192:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352213:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352227:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352235:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352242:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352248:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352317:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574192.352357:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352364:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352388:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352394:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574192.352415:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352424:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352437:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a7b2398800) 00010000:00010000:1.0:1788574192.352440:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788574192.352456:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352463:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535aed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352485:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352490:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352495:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352500:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574192.352503:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352509:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352517:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:1.0:1788574192.352519:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574192.352528:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.352535:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535adf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574192.352547:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a23da4f reply state 00000000ee858fe2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574192.352556:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574192.352657:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727653376:12345-192.168.201.57@tcp:36:rm.0 Request processed in 5471us (5945us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788574192.352665:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00010000:00010000:1.0:1788574192.358080:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.358100:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.358109:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.358115:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574192.358120:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.358129:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.358147:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff90a78544ff00) 00010000:00010000:1.0:1788574192.358150:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574192.358156:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574192.358170:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535ae6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574192.361346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574192.361472:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727653632 00000100:00100000:2.0:1788574192.361482:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727653632 00000100:00100000:2.0:1788574192.361545:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574192.361555:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:9678:x1875455727653632:12345-192.168.201.57@tcp:35:rm.0 00000100:00100000:2.0:1788574192.361791:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727653632:12345-192.168.201.57@tcp:35:rm.0 Request processed in 227us (446us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788574192.361799:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00010000:00010000:0.0:1788574192.367182:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574192.367198:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.367209:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574192.367214:0:6727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.367223:0:6727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.367242:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90a7b2398800) 00010000:00010000:0.0:1788574192.367244:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788574192.367267:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.367273:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535af4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.367294:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574192.367295:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574192.367297:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574192.374713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574192.374807:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727653888 00000100:00100000:0.0:1788574192.374818:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727653888 00000100:00100000:0.0:1788574192.374890:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788574192.374900:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:9678:x1875455727653888:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:0.0:1788574192.375165:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788574192.375192:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535ab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3789 expref: 16 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.375214:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3766 expref: 15 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.375225:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574192.375240:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535a14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3758 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.375251:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7b2398200) 00010000:00010000:0.0:1788574192.375259:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574192.375283:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.375295:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574192.375312:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.377270:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.377292:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.377305:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.377836:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.377846:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.377855:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574192.381592:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788574192.381633:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381669:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381678:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381684:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574192.381690:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381698:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381715:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90a782d70900) 00010000:00010000:2.0:1788574192.381719:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788574192.381725:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381731:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b535b09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381765:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381771:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.381777:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.383743:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574192.383767:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.383790:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.383807:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544f800) 00010000:00010000:2.0:1788574192.383810:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574192.383815:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574192.383822:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535afb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574192.383848:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025abc8f8 reply state 000000001154b3e8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574192.383858:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574192.383974:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:9678:x1875455727653888:12345-192.168.201.57@tcp:36:rm.0 Request processed in 9072us (9268us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788574192.383982:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00010000:00010000:3.0:1788574192.388345:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574192.388364:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574192.388398:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574192.388404:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574192.388409:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574192.388417:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574192.388465:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a78544f500) 00010000:00010000:3.0:1788574192.388469:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574192.388475:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574192.388481:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535b02 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574192.773204:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747609728:0@lo:400:kworker.0 00000100:00100000:3.0:1788574192.773292:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574192.773361:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574192.773401:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747609600:0@lo:400:kworker.0 00000100:00100000:3.0:1788574192.773445:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574192.773607:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609600 00000100:00100000:1.0:1788574192.773618:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609600 00000100:00100000:1.0:1788574192.773698:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574192.773711:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747609600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574192.773773:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747609600:12345-0@lo:400:kworker.0 Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574192.773781:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574192.773819:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747609600:0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.773983:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747609472:0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774014:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574192.774045:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747609984:0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774066:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574192.774090:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788574192.774096:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747609344:0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774121:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574192.774141:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747609856:0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774162:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574192.774202:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609728 00000100:00100000:0.0:1788574192.774207:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609728 00000100:00100000:0.0:1788574192.774239:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609984 00000100:00100000:0.0:1788574192.774242:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609984 00000100:00100000:0.0:1788574192.774263:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574192.774270:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747609728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774307:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747609728:12345-0@lo:400:kworker.0 Request processed in 37us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.774313:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574192.774326:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788574192.774332:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747609984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774363:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747609984:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.774426:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788574192.774446:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609344 00000100:00100000:0.0:1788574192.774450:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609344 00000100:00100000:0.0:1788574192.774474:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788574192.774481:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747609344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.774512:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747609344:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574192.774519:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788574192.774557:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747609344:0@lo:400:kworker.0 00010000:00080000:0.0:1788574192.774569:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a792459880 x1875455747609984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574192.774579:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747609984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574192.775023:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609472 00000100:00100000:2.0:1788574192.775030:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609472 00000100:00100000:2.0:1788574192.775072:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747609856 00000100:00100000:2.0:1788574192.775076:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747609856 00000100:00100000:2.0:1788574192.775101:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574192.775109:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747609472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574192.775153:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747609472:12345-0@lo:400:kworker.0 Request processed in 45us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574192.775158:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574192.775173:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574192.775189:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747609856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574192.775220:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747609856:12345-0@lo:400:kworker.0 Request processed in 32us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574192.775226:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1788574192.775325:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a793284000 x1875455747609728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574192.775336:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747609728:0@lo:400:kworker.0 00000100:00080000:3.0:1788574192.782424:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574192.782462:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574192.782473:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574192.783500:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747609856:0@lo:400:kworker.0 00000100:00100000:0.0:1788574192.783543:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747609472:0@lo:400:kworker.0 00010000:00010000:0.0:1788574192.960789:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574193.282404:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747610112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574193.282513:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574193.282613:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610112 00000100:00100000:0.0:1788574193.282628:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610112 00000100:00100000:0.0:1788574193.282695:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574193.282706:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747610112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574193.282752:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574193.282806:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747610112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574193.282812:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788574193.282935:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79245ad80 x1875455747610112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574193.282956:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747610112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788574193.984723:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574195.008557:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788574195.841178:0:6989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322015806967ns, next at 323015802772ns, rc = 0 00000100:00100000:0.0:1788574195.841412:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747610240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574195.841503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.841787:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610240 00000100:00100000:0.0:1788574195.841797:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610240 00000100:00100000:0.0:1788574195.841866:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574195.841875:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747610240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574195.841909:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574195.841955:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747610240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.841962:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788574195.841985:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574195.842017:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a792459880 x1875455747610240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574195.842041:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747610240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574196.032627:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574196.523596:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574196.523643:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574196.523683:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574196.523776:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574196.523799:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654016 00000100:00100000:0.0:1788574196.523811:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654016 00000100:00100000:1.0:1788574196.523835:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654272 00000100:00100000:1.0:1788574196.523854:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654272 00000100:00100000:0.0:1788574196.523955:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 251 00000100:00100000:0.0:1788574196.523967:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727654016:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574196.524038:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727654016:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 74us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574196.524045:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 251 00000100:00100000:1.0:1788574196.524127:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:1.0:1788574196.524135:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727654272:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574196.524165:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727654272:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574196.524189:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00080000:1.0:1788574196.524225:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574196.524270:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654144 00000100:00100000:2.0:1788574196.524275:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654144 00000100:00100000:2.0:1788574196.524310:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654400 00000100:00100000:2.0:1788574196.524313:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654400 00000100:00100000:2.0:1788574196.524336:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:2.0:1788574196.524344:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2353:x1875455727654144:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574196.524406:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2353:x1875455727654144:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 64us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574196.524413:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:2.0:1788574196.524428:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:2.0:1788574196.524435:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727654400:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:3.0:1788574196.524635:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574196.524947:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727654400:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 510us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574196.524955:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 104 00010000:00010000:3.0:1788574197.057575:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574197.280312:0:11640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1788574197.512147:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:3.0:1788574197.512170:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1788574197.512175:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788574197.512197:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788574197.512215:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1788574197.514556:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574197.514587:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747610368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788574197.514658:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574197.514961:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610368 00000100:00100000:3.0:1788574197.514972:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610368 00000100:00100000:3.0:1788574197.515034:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574197.515044:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747610368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788574197.515074:0:6713:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788574197.515108:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b79f0, atime: 0x6a9b79f0, ctime: 0x6a9b79f0, blocks: 0x1 00010000:00010000:3.0:1788574197.515116:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574197.515130:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1788574197.515134:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574197.515140:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574197.515156:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574197.515166:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574197.515172:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574197.515193:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574197.515517:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574197.515525:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574197.515593:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574197.515599:0:6727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574197.515611:0:6727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574197.515633:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574197.515642:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077e65b7f/0x10531a153b535b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574197.515664:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574197.515667:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574197.515669:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574197.517751:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875455747610368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2700us (3084us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788574197.517764:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788574197.517808:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788574197.517912:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7bb289c00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788574197.517921:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747610368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788574197.889566:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747610624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.889656:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574197.889732:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747611136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.889759:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574197.889790:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574197.889796:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747610752:0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.889830:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574197.890158:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747610880:0@lo:400:kworker.0 00000100:00100000:3.0:1788574197.890190:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574197.890211:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788574197.890217:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747610496:0@lo:400:kworker.0 00000100:00100000:3.0:1788574197.890240:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574197.890325:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747611136 00000100:00100000:1.0:1788574197.890334:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747611136 00000100:00100000:1.0:1788574197.890420:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610880 00000100:00100000:1.0:1788574197.890424:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610880 00000100:00100000:1.0:1788574197.890447:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574197.890454:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747611136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574197.896674:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747611008:0@lo:400:kworker.0 00000100:00100000:3.0:1788574197.896751:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574197.896868:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610496 00000100:00100000:3.0:1788574197.897014:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610496 00000100:00100000:3.0:1788574197.897082:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788574197.897092:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747610496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574197.897148:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747610496:12345-0@lo:400:kworker.0 Request processed in 57us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574197.897155:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788574197.897188:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610624 00000100:00100000:3.0:1788574197.897192:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610624 00000100:00100000:3.0:1788574197.897222:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747610752 00000100:00100000:3.0:1788574197.897225:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747610752 00000100:00100000:3.0:1788574197.897241:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747611008 00000100:00100000:3.0:1788574197.897243:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747611008 00000100:00100000:3.0:1788574197.897258:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788574197.897264:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747610624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574197.897359:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747611136:12345-0@lo:400:kworker.0 Request processed in 6903us (7597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574197.897384:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574197.897410:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574197.897418:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747610752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574197.897507:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574197.897517:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1788574197.899670:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574197.899681:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574197.899712:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574197.899735:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747610880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.899827:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747610880:12345-0@lo:400:kworker.0 Request processed in 96us (9627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574197.899836:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574197.900038:0:10109:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788574197.900050:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574197.900123:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747611008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.900165:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747611008:12345-0@lo:400:kworker.0 Request processed in 108us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574197.900172:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574197.900416:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747610496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.900431:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747611008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574197.900443:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747610880:0@lo:400:kworker.0 00000100:00100000:3.0:1788574197.900557:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747610624:12345-0@lo:400:kworker.0 Request processed in 3291us (10899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574197.900565:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574197.900698:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747610752:12345-0@lo:400:kworker.0 Request processed in 3280us (10876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574197.900707:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574197.905804:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747610752:0@lo:400:kworker.0 00000100:00100000:2.0:1788574197.905839:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747610624:0@lo:400:kworker.0 00010000:00080000:2.0:1788574197.906052:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7926b2a00 x1875455747611136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574197.906148:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747611136:0@lo:400:kworker.0 00010000:00010000:0.0:1788574198.083155:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574198.408010:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747611264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574198.408084:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574198.408164:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747611264 00000100:00100000:1.0:1788574198.408172:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747611264 00000100:00100000:1.0:1788574198.408215:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574198.408237:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747611264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574198.408273:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574198.408328:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747611264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574198.408336:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788574198.408393:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7beed80 x1875455747611264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574198.408412:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747611264:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788574198.930341:0:11691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffb5c7c60 20000000:00000080:1.0:1788574198.930360:0:11691:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a79e881800 uarg=0000000000000000 20000000:01000000:1.0:1788574198.930418:0:11691:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788574198.930424:0:11691:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788574198.930429:0:11691:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788574198.941889:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788574198.942316:0:11691:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788574198.960909:0:11691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788574198.960984:0:11691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788574198.961052:0:11691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788574198.961073:0:11691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788574198.961097:0:11691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961116:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5359b2 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961124:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5359c0 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961131:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5359ce expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961140:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961148:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961156:0:11691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961200:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.961222:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 12 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.969716:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611392:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574198.969861:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.969873:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 12 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.969882:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611520:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574198.969914:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5359ce expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.969922:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5359ce expref: 18 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.969930:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611648:0@lo:104: 00000100:00100000:2.0:1788574198.969975:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574198.970008:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5359c0 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.970015:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5359c0 expref: 18 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.970024:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611776:0@lo:104: 00000100:00100000:2.0:1788574198.970039:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574198.970064:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5359b2 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.970072:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5359b2 expref: 18 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.970086:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611904:0@lo:104: 00000100:00100000:2.0:1788574198.970106:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574198.970114:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574198.970334:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788574198.970363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747611648 00000100:00100000:1.0:1788574198.970519:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747611648 00000100:00100000:1.0:1788574198.970557:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747611776 00000100:00100000:1.0:1788574198.970559:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747611776 00000100:00100000:1.0:1788574198.970566:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747611904 00000100:00100000:1.0:1788574198.970568:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747611904 00000100:00100000:1.0:1788574198.970579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788574198.970587:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+5:11691:x1875455747611648:12345-0@lo:104: 00010000:00010000:1.0:1788574198.970600:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.970657:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574198.970663:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+5:11691:x1875455747611648:12345-0@lo:104: Request processed in 77us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574198.970670:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788574198.970690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574198.970695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:11691:x1875455747611776:12345-0@lo:104: 00010000:00010000:1.0:1788574198.970702:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.970729:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788574198.970733:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+4:11691:x1875455747611776:12345-0@lo:104: Request processed in 38us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574198.970739:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574198.970747:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574198.970752:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bba1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:11691:x1875455747611904:12345-0@lo:104: 00010000:00010000:1.0:1788574198.970758:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.970779:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788574198.970784:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bba1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a547233-5b7a-4801-b1c0-26875afe1265+3:11691:x1875455747611904:12345-0@lo:104: Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574198.970789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788574198.970880:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788574198.970887:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.970894:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574198.970899:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.970908:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574198.970920:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574198.970926:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788574198.970961:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.970967:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574198.970992:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971000:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4cc00/0x10531a153b5359ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971012:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574198.971015:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971020:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574198.971023:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971030:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574198.971037:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574198.971042:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788574198.971057:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971063:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574198.971068:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971074:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b5359c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971082:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574198.971084:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971089:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574198.971093:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971100:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574198.971106:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574198.971110:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788574198.971118:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971123:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574198.971132:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971146:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d000/0x10531a153b5359b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5359b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971158:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574198.971160:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574198.971161:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574198.971166:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574198.971178:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747612032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574198.971207:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574198.971250:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574198.971255:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747612160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574198.971273:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574198.971292:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612032 00000100:00100000:0.0:1788574198.971296:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612032 00010000:00010000:0.0:1788574198.971312:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5359ce expref: 19 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574198.971330:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612160 00000100:00100000:0.0:1788574198.971332:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612160 00010000:00010000:0.0:1788574198.971341:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5359c0 expref: 20 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574198.971352:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574198.971358:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+20:3314:x1875455747612032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574198.971390:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574198.971396:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5359ce expref: 20 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971416:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5359ce expref: 20 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971432:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574198.971455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+20:3314:x1875455747612032:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574198.971461:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574198.971474:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574198.971480:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747612160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574198.971486:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574198.971490:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5359c0 expref: 19 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971498:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5359c0 expref: 19 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.971507:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574198.971522:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747612160:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574198.971528:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574198.971557:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747612160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574198.971564:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747612032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574198.971593:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b600/0x10531a153b5359d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5359ce expref: 18 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574198.971603:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611648:0@lo:104: 00010000:00010000:0.0:1788574198.971617:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a400/0x10531a153b5359c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5359c0 expref: 17 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574198.971625:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611776:0@lo:104: 00000100:00100000:0.0:1788574198.971632:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611904:0@lo:104: 00000100:00100000:1.0:1788574198.971940:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747612288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574198.971970:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574198.972015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612288 00000100:00100000:1.0:1788574198.972019:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612288 00010000:00010000:1.0:1788574198.972035:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5359b2 expref: 17 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574198.972052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574198.972057:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79260a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+17:3312:x1875455747612288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574198.972064:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574198.972074:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5359b2 expref: 17 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.972083:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5359b2 expref: 17 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.972093:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e984600/0x10531a153b5359b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5359b2 expref: 17 pid: 5852 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.972102:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574198.972130:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79260a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a547233-5b7a-4801-b1c0-26875afe1265+16:3312:x1875455747612288:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574198.972136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574198.972180:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747612288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574198.974463:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574198.984480:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574198.984558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574198.984589:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654528 00000100:00100000:0.0:1788574198.984598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654528 00010000:00010000:0.0:1788574198.984634:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 13 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574198.984663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654656 00000100:00100000:0.0:1788574198.984666:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654656 00010000:00010000:0.0:1788574198.984679:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 14 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574198.984694:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788574198.984703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec16a69b-cbad-484e-9f31-b00eca338977+14:2355:x1875455727654528:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574198.984717:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574198.984723:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.984736:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574198.984754:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574198.984815:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec16a69b-cbad-484e-9f31-b00eca338977+14:2355:x1875455727654528:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574198.984837:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:1.0:1788574198.984956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:1.0:1788574198.984966:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+14:2355:x1875455727654656:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574198.984975:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574198.984979:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 14 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.984994:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 14 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985008:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985018:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985032:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985045:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985052:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985059:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985064:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574198.985069:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985076:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985084:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574198.985094:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574198.985115:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+14:2355:x1875455727654656:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 152us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574198.985121:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00010000:00010000:2.0:1788574198.985211:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4ce00/0x10531a153b5359e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce374a expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.985240:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611392:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574198.985252:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b800/0x10531a153b5359dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3743 expref: 13 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574198.985261:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875455747611520:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574198.985306:0:11691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.985315:0:11691:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.985322:0:11691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574198.985328:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e984000/0x10531a153b535b17 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574199.104944:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574200.119439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574200.119561:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654784 00000100:00100000:1.0:1788574200.119576:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654784 00000100:00100000:1.0:1788574200.119641:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 253 00000100:00100000:1.0:1788574200.119660:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+11:5596:x1875455727654784:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574200.119674:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574200.119716:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20a00/0x10531a153b535b1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3797 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574200.119749:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20a00/0x10531a153b535b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3797 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574200.119761:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20a00/0x10531a153b535b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3797 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574200.119772:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20a00, rc 0) 00000100:00100000:1.0:1788574200.119850:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727654784:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 191us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.119857:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 253 00000100:00100000:2.0:1788574200.123019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574200.123116:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727654912 00000100:00100000:0.0:1788574200.123125:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727654912 00000100:00100000:0.0:1788574200.123174:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 254 00000100:00100000:0.0:1788574200.123184:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727654912:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574200.123521:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727654912:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 337us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.123531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 254 00010000:00010000:0.0:1788574200.130157:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574200.131879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574200.132103:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655040 00000100:00100000:1.0:1788574200.132117:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655040 00000100:00100000:1.0:1788574200.132176:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 255 00000100:00100000:1.0:1788574200.132189:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727655040:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574200.132512:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727655040:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 324us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.132521:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 255 00000100:00100000:3.0:1788574200.153549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574200.153865:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655168 00000100:00100000:1.0:1788574200.153878:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655168 00000100:00100000:1.0:1788574200.153950:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 256 00000100:00100000:1.0:1788574200.153961:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+12:9949:x1875455727655168:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574200.154263:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+12:9949:x1875455727655168:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 303us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.154271:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 256 00000100:00100000:2.0:1788574200.178904:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574200.179182:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655296 00000100:00100000:0.0:1788574200.179197:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655296 00000100:00100000:0.0:1788574200.179268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 257 00000100:00100000:0.0:1788574200.179279:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:9949:x1875455727655296:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574200.179598:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+12:9949:x1875455727655296:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 320us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.179608:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 257 00000100:00100000:0.0:1788574200.185909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574200.186163:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655424 00000100:00100000:3.0:1788574200.186174:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655424 00000100:00100000:3.0:1788574200.186286:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 258 00000100:00100000:3.0:1788574200.186297:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+12:5596:x1875455727655424:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574200.186314:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574200.186341:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a780031a00/0x10531a153b535b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce379e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574200.186409:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a780031a00/0x10531a153b535b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce379e expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574200.186421:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a780031a00/0x10531a153b535b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce379e expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574200.186433:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780031a00, rc 0) 00000100:00100000:3.0:1788574200.187676:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727655424:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 1375us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574200.187685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 258 00000100:00100000:2.0:1788574200.196038:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574200.196171:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655552 00000100:00100000:1.0:1788574200.196181:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655552 00000100:00100000:1.0:1788574200.196240:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 259 00000100:00100000:1.0:1788574200.196252:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727655552:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574200.196957:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727655552:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 702us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.196966:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 259 00000100:00100000:2.0:1788574200.202545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574200.202840:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655680 00000100:00100000:0.0:1788574200.202852:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655680 00000100:00100000:0.0:1788574200.202933:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 260 00000100:00100000:0.0:1788574200.202946:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727655680:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574200.203296:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:5596:x1875455727655680:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 353us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.203312:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 260 00000100:00100000:0.0:1788574200.222733:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574200.222848:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655808 00000100:00100000:3.0:1788574200.222861:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655808 00000100:00100000:3.0:1788574200.222926:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 261 00000100:00100000:3.0:1788574200.222950:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:9952:x1875455727655808:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574200.225250:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:9952:x1875455727655808:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 2304us (2520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.225275:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 261 00000100:00100000:3.0:1788574200.231998:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574200.232202:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727655936 00000100:00100000:2.0:1788574200.232213:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727655936 00000100:00100000:2.0:1788574200.232270:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 262 00000100:00100000:2.0:1788574200.232281:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:9952:x1875455727655936:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574200.232880:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:9952:x1875455727655936:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 598us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.232890:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 262 00000100:00100000:0.0:1788574200.960945:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574200.960970:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574200.961054:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788574200.963666:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574200.963674:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6812f6000 from 7 10000000:01000000:0.0:1788574200.963679:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574200.963744:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574200.963758:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574200.963778:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574200.963811:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747612544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574200.963897:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574200.963955:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574200.964510:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612544 00000100:00100000:1.0:1788574200.964520:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612544 00000100:00100000:1.0:1788574200.964590:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788574200.964600:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+16:5854:x1875455747612544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574200.964614:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574200.964640:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20000/0x10531a153b535b33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535b2c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574200.964665:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20000/0x10531a153b535b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535b2c expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574200.964676:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20000/0x10531a153b535b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535b2c expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574200.964686:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20000, rc 0) 00000100:00100000:1.0:1788574200.964749:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747612544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.964756:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788574200.964920:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747612544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574200.964936:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574200.964966:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574200.965037:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747612672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574200.965135:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574200.965170:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574200.966707:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612672 00000100:00100000:1.0:1788574200.966719:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612672 00000100:00100000:1.0:1788574200.966791:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788574200.966816:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747612672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574200.968535:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747612672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1713us (3391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.968547:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788574200.972734:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612416 00000100:00100000:2.0:1788574200.972750:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612416 00000100:00100000:2.0:1788574200.972846:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574200.972858:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747612416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574200.972896:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574200.972985:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747612416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (11931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.972993:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574200.973054:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747612416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574200.973252:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574200.979749:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747612672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574200.979839:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747612800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574200.979926:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574200.979986:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574200.980249:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612800 00000100:00100000:1.0:1788574200.980256:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612800 00000100:00100000:1.0:1788574200.980313:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788574200.980322:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747612800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574200.980527:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747612800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.980535:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788574200.981436:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747612800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574200.984414:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11704:1875455747612928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574200.984496:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574200.984543:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574200.984824:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747612928 00000100:00100000:2.0:1788574200.984833:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747612928 00000100:00100000:2.0:1788574200.984896:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788574200.984906:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:11704:x1875455747612928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574200.985332:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+17:11704:x1875455747612928:12345-0@lo:502:llog_process_th.0 Request processed in 426us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.985340:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788574200.992449:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11704:1875455747612928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574200.992967:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574200.992982:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574200.992984:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788574200.992992:0:11704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6812f6000 00000020:00000080:2.0:1788574200.992995:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788574200.995507:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11704:1875455747613056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574200.995898:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.995950:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574200.996798:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613056 00000100:00100000:1.0:1788574200.996809:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613056 00000100:00100000:1.0:1788574200.996868:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788574200.996878:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:11704:x1875455747613056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574200.997225:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+17:11704:x1875455747613056:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.997233:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788574201.000264:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11704:1875455747613056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574201.000318:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574201.000327:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574201.000329:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788574201.000333:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788574201.000526:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788574201.000546:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574201.000558:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574201.000571:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574201.000582:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574201.000585:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a785e1b800 from 7 10000000:01000000:2.0:1788574201.000588:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574201.000619:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574201.000628:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574201.000638:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574201.000664:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574201.000732:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574201.000764:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.000915:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613184 00000100:00100000:1.0:1788574201.000922:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613184 00000100:00100000:1.0:1788574201.000973:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788574201.000983:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+17:5854:x1875455747613184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574201.000995:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574201.001011:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21c00/0x10531a153b535b41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535b3a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.001034:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21c00/0x10531a153b535b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535b3a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.001046:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21c00/0x10531a153b535b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535b3a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.001128:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21c00, rc 0) 00000100:00100000:1.0:1788574201.001171:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747613184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.001179:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788574201.001214:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574201.001225:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.001235:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574201.001276:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.001300:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574201.001318:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e38900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.001330:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613312 00000100:00100000:1.0:1788574201.001334:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613312 00000100:00100000:1.0:1788574201.001354:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788574201.001360:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747613312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.001640:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747613312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.001653:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788574201.001988:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.002023:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.002229:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574201.002244:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783575900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.002258:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613440 00000100:00100000:1.0:1788574201.002262:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613440 00000100:00100000:1.0:1788574201.002285:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788574201.002301:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747613440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.002456:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747613440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.002463:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788574201.002501:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.008076:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11705:1875455747613568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574201.008159:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574201.008197:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613568 00000100:00100000:1.0:1788574201.008205:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613568 00000100:00100000:1.0:1788574201.008247:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788574201.008255:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:11705:x1875455747613568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574201.010991:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:11705:x1875455747613568:12345-0@lo:502:llog_process_th.0 Request processed in 2727us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.011008:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788574201.013791:0:11705:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7835750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574201.013833:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11705:1875455747613568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574201.017238:0:11705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574201.017252:0:11705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574201.017255:0:11705:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788574201.017263:0:11705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a785e1b800 00000020:00000080:0.0:1788574201.017266:0:11705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788574201.017385:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11705:1875455747613696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574201.017461:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574201.017504:0:11705:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574201.017547:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613696 00000100:00100000:0.0:1788574201.017554:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613696 00000100:00100000:0.0:1788574201.017596:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788574201.017605:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:11705:x1875455747613696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574201.019432:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+18:11705:x1875455747613696:12345-0@lo:502:llog_process_th.0 Request processed in 1823us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574201.019444:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788574201.019514:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11705:1875455747613696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574201.019542:0:11705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574201.019548:0:11705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574201.019550:0:11705:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788574201.019555:0:11705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788574201.019806:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788574201.019823:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574201.019841:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.019852:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574201.019862:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574201.019865:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a790a3d000 from 7 10000000:01000000:1.0:1788574201.019868:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574201.019896:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.019905:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.019915:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574201.019933:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.019967:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574201.019996:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783575b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.020011:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613824 00000100:00100000:1.0:1788574201.020017:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613824 00000100:00100000:1.0:1788574201.020047:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788574201.020054:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+18:5854:x1875455747613824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574201.020134:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574201.020149:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21200/0x10531a153b535b4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b535b48 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.020170:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21200/0x10531a153b535b4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b535b48 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.020188:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21200/0x10531a153b535b4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b535b48 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.020198:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21200, rc 0) 00000100:00100000:1.0:1788574201.020227:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747613824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.020234:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788574201.020263:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574201.020275:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.020283:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574201.020342:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.020386:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574201.020401:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783575b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.020412:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747613952 00000100:00100000:1.0:1788574201.020415:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747613952 00000100:00100000:1.0:1788574201.020430:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788574201.020436:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747613952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.020636:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747613952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.020643:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788574201.020671:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747613952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.021271:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747614080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.021311:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574201.021327:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783575b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.021341:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614080 00000100:00100000:1.0:1788574201.021346:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614080 00000100:00100000:1.0:1788574201.021364:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788574201.021400:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747614080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574201.021524:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:5854:x1875455747614080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.021531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788574201.021576:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a547233-5b7a-4801-b1c0-26875afe1265:5854:1875455747614080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574201.028799:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11707:1875455747614208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574201.028879:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574201.028921:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574201.029730:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614208 00000100:00100000:1.0:1788574201.029740:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614208 00000100:00100000:1.0:1788574201.029795:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788574201.029804:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:11707:x1875455747614208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574201.030026:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:11707:x1875455747614208:12345-0@lo:502:llog_process_th.0 Request processed in 222us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.030034:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788574201.040840:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11707:1875455747614208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574201.040894:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574201.040905:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574201.040907:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574201.040913:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a790a3d000 00000020:00000080:3.0:1788574201.040916:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574201.041006:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11707:1875455747614336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574201.041087:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574201.041127:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614336 00000100:00100000:3.0:1788574201.041134:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614336 00000100:00100000:3.0:1788574201.041176:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788574201.041184:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:11707:x1875455747614336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574201.043956:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:11707:x1875455747614336:12345-0@lo:502:llog_process_th.0 Request processed in 2763us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574201.043970:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788574201.044219:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574201.044246:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a547233-5b7a-4801-b1c0-26875afe1265:11707:1875455747614336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574201.044276:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574201.044283:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574201.044285:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788574201.044289:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788574201.047683:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788574201.047729:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574201.047740:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574201.047753:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574201.061174:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574201.152901:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574201.646174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574201.646231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574201.646296:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656064 00000100:00100000:3.0:1788574201.646305:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574201.646310:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656064 00000100:00100000:3.0:1788574201.646365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574201.646417:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656192 00000100:00100000:2.0:1788574201.646434:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656192 00000100:00100000:2.0:1788574201.646503:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:2.0:1788574201.646515:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727656192:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574201.646623:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727656192:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 110us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574201.646632:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:0.0:1788574201.646890:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 278 00000100:00100000:0.0:1788574201.646899:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727656064:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574201.646925:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727656064:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574201.646932:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 278 00000100:00080000:0.0:1788574201.647295:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574201.647357:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656320 00000100:00100000:1.0:1788574201.647363:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656320 00000100:00100000:1.0:1788574201.647439:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788574201.647447:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727656320:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574201.647482:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727656320:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 36us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.647489:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788574201.647577:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656448 00000100:00100000:1.0:1788574201.647582:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656448 00000100:00100000:1.0:1788574201.647626:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:1.0:1788574201.647635:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727656448:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574201.647677:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727656448:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 44us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574201.647684:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00080000:0.0:1788574201.652774:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574201.652786:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788574202.115598:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574202.176519:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788574202.645044:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788574203.008881:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747614848:0@lo:400:kworker.0 00000100:00100000:2.0:1788574203.008965:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574203.009036:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574203.009047:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747614720:0@lo:400:kworker.0 00000100:00100000:2.0:1788574203.009091:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574203.009149:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614720 00000100:00100000:2.0:1788574203.009160:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614720 00000100:00100000:2.0:1788574203.009234:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574203.009250:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574203.009312:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747614720:12345-0@lo:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574203.009320:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788574203.009355:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574203.009413:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747614720:0@lo:400:kworker.0 00000100:00100000:1.0:1788574203.009753:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747614592:0@lo:400:kworker.0 00000100:00100000:1.0:1788574203.009785:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574203.009812:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747615104:0@lo:400:kworker.0 00000100:00100000:1.0:1788574203.009834:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574203.009867:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788574203.009873:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747614464:0@lo:400:kworker.0 00000100:00100000:1.0:1788574203.009901:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574203.009922:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747614976:0@lo:400:kworker.0 00000100:00100000:1.0:1788574203.009943:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574203.009977:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614464 00000100:00100000:1.0:1788574203.009982:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614464 00000100:00100000:1.0:1788574203.010010:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788574203.010020:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747614464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574203.010080:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747614464:12345-0@lo:400:kworker.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574203.010091:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788574203.010145:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747614464:0@lo:400:kworker.0 00000100:00100000:3.0:1788574203.010272:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614848 00000100:00100000:3.0:1788574203.010277:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614848 00000100:00100000:3.0:1788574203.010331:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615104 00000100:00100000:3.0:1788574203.010334:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615104 00000100:00100000:3.0:1788574203.010357:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574203.010364:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747614848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574203.010428:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747614848:12345-0@lo:400:kworker.0 Request processed in 65us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574203.010434:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574203.010447:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574203.010453:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574203.010485:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747615104:12345-0@lo:400:kworker.0 Request processed in 32us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574203.010490:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574203.010517:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614592 00000100:00100000:3.0:1788574203.010521:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614592 00000100:00100000:3.0:1788574203.010541:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747614976 00000100:00100000:3.0:1788574203.010544:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747614976 00000100:00100000:3.0:1788574203.010560:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788574203.010566:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747614592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574203.010607:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747614592:12345-0@lo:400:kworker.0 Request processed in 32us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574203.010613:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788574203.010625:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788574203.010631:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747614976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574203.010658:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747614976:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574203.010664:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788574203.010699:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747614976:0@lo:400:kworker.0 00000100:00100000:3.0:1788574203.010709:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747614592:0@lo:400:kworker.0 00010000:00080000:3.0:1788574203.010720:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bfaa0a80 x1875455747615104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574203.010730:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747615104:0@lo:400:kworker.0 00000100:00080000:1.0:1788574203.011392:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574203.011397:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574203.011399:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574203.012676:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788574203.012685:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7bb289c00, transno 4294967300 00000100:00100000:2.0:1788574203.012707:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747614848:0@lo:400:kworker.0 00010000:00010000:0.0:1788574203.201485:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574203.525627:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747615232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574203.525709:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574203.525936:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615232 00000100:00100000:3.0:1788574203.525944:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615232 00000100:00100000:3.0:1788574203.525999:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788574203.526010:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747615232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574203.526044:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574203.526109:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747615232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574203.526124:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788574203.526164:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e888380 x1875455747615232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574203.526182:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747615232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574204.227644:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574205.248507:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574206.080831:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574206.080866:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747615360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574206.080957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574206.081227:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615360 00000100:00100000:3.0:1788574206.081238:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615360 00000100:00100000:3.0:1788574206.081320:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574206.081330:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747615360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574206.081390:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574206.081440:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747615360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574206.081447:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788574206.081612:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574206.081651:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747615360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574206.272612:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574206.765574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574206.765618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574206.765653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574206.765735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574206.765767:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656704 00000100:00100000:3.0:1788574206.765777:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656704 00000100:00100000:3.0:1788574206.765836:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656960 00000100:00100000:3.0:1788574206.765839:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656960 00000100:00100000:3.0:1788574206.765864:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:3.0:1788574206.765875:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727656704:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574206.765961:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727656704:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574206.765968:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:3.0:1788574206.766012:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:3.0:1788574206.766020:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727656960:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574206.766046:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727656960:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574206.766052:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:1.0:1788574206.766220:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656576 00000100:00100000:1.0:1788574206.766225:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656576 00000100:00100000:1.0:1788574206.766260:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 280 00000100:00100000:1.0:1788574206.766268:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727656576:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574206.766295:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727656576:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 28us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574206.766302:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 280 00000100:00100000:0.0:1788574206.766436:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727656832 00000100:00100000:0.0:1788574206.766441:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727656832 00000100:00100000:0.0:1788574206.766485:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:0.0:1788574206.766492:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727656832:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574206.766522:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727656832:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574206.766528:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00080000:2.0:1788574206.766730:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574206.766735:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574207.297238:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574208.131725:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747615872:0@lo:400:kworker.0 00000100:00100000:1.0:1788574208.131797:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574208.131862:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574208.131868:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747615744:0@lo:400:kworker.0 00000100:00100000:1.0:1788574208.131895:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574208.131932:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615744 00000100:00100000:1.0:1788574208.131939:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615744 00000100:00100000:1.0:1788574208.132005:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788574208.132015:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574208.132090:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747615744:12345-0@lo:400:kworker.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574208.132104:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1788574208.132123:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574208.132150:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747615744:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.134055:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747615488:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.134139:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574208.134200:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747616000:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.134231:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574208.134268:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574208.134275:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747615616:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.134296:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574208.134317:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747616128:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.134340:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574208.134482:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616000 00000100:00100000:2.0:1788574208.134490:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616000 00000100:00100000:2.0:1788574208.134534:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615616 00000100:00100000:2.0:1788574208.134537:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615616 00000100:00100000:2.0:1788574208.134556:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788574208.134564:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747616000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574208.134617:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747616000:12345-0@lo:400:kworker.0 Request processed in 54us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574208.134625:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788574208.134641:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788574208.134657:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747615616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574208.134695:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747615616:12345-0@lo:400:kworker.0 Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574208.134714:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788574208.134767:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615872 00000100:00100000:2.0:1788574208.134771:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615872 00000100:00100000:2.0:1788574208.134797:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616128 00000100:00100000:2.0:1788574208.134800:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616128 00000100:00100000:2.0:1788574208.134817:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574208.134822:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747615872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574208.134854:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747615872:12345-0@lo:400:kworker.0 Request processed in 31us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574208.134859:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574208.134868:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788574208.134873:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747616128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574208.134894:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747616128:12345-0@lo:400:kworker.0 Request processed in 22us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574208.134899:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788574208.135421:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747615616:0@lo:400:kworker.0 00010000:00080000:0.0:1788574208.135584:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a793285f80 x1875455747616128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574208.135607:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747616128:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.135621:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747616000:0@lo:400:kworker.0 00000100:00100000:1.0:1788574208.136742:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747615488 00000100:00100000:1.0:1788574208.136756:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747615488 00000100:00100000:1.0:1788574208.136823:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788574208.136832:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747615488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574208.136916:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747615488:12345-0@lo:400:kworker.0 Request processed in 85us (2776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574208.136922:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1788574208.136962:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574208.137150:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574208.137155:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574208.137203:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747615872:0@lo:400:kworker.0 00000100:00100000:0.0:1788574208.138137:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747615488:0@lo:400:kworker.0 00010000:00010000:0.0:1788574208.323462:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574208.644251:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747616256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574208.644335:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574208.644910:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616256 00000100:00100000:3.0:1788574208.644921:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616256 00000100:00100000:3.0:1788574208.644980:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788574208.644991:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747616256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574208.645025:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574208.645097:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747616256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574208.645105:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788574208.645350:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e88a300 x1875455747616256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574208.645389:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747616256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574209.344555:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574210.368683:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574211.200935:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747616384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574211.201010:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574211.201265:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616384 00000100:00100000:3.0:1788574211.201274:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616384 00000100:00100000:3.0:1788574211.201414:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574211.201425:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747616384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574211.201462:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574211.201520:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747616384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574211.201527:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788574211.201691:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747616384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574211.201907:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574211.392558:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574211.887948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574211.888154:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574211.888289:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657088 00000100:00100000:2.0:1788574211.888294:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657216 00000100:00100000:3.0:1788574211.888299:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657088 00000100:00100000:2.0:1788574211.888299:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657216 00000100:00100000:3.0:1788574211.888353:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 282 00000100:00100000:2.0:1788574211.888353:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:3.0:1788574211.888363:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727657088:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574211.888363:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727657216:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:1.0:1788574211.888681:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574211.888784:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727657216:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 421us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.888793:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:3.0:1788574211.914052:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727657088:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25673us (26097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574211.914085:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 282 00000100:00100000:2.0:1788574211.914226:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574211.914433:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574211.914615:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657472 00000100:00100000:1.0:1788574211.914624:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657472 00000100:00100000:1.0:1788574211.914684:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:1.0:1788574211.914700:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727657472:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788574211.914737:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574211.914772:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727657472:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 72us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574211.914779:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:3.0:1788574211.914939:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657344 00000100:00100000:3.0:1788574211.914944:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657344 00000100:00100000:3.0:1788574211.915083:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788574211.915091:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2352:x1875455727657344:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:3.0:1788574211.915111:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535a8b 00000100:00080000:3.0:1788574211.915119:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a785f07800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788574211.915156:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788574211.915172:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574211.917772:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+2:2352:x1875455727657344:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 2665us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574211.917791:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00080000:1.0:1788574211.921633:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788574212.353132:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574212.416738:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788574212.892795:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:2.0:1788574212.892805:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a785f01800/f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:1.0:1788574212.893097:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785f01800/f540d78c-33c0-4206-a4f5-51879daa7a3f for lustre-OST0000 00000020:00000080:1.0:1788574212.893148:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a785f07800 for lustre-OST0000 00000100:00100000:0.0:1788574213.251163:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747616896:0@lo:400:kworker.0 00000100:00100000:0.0:1788574213.251233:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574213.251302:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574213.251308:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747616768:0@lo:400:kworker.0 00000100:00100000:0.0:1788574213.251333:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574213.251395:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616896 00000100:00100000:0.0:1788574213.251403:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616896 00000100:00100000:0.0:1788574213.251462:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574213.252137:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747616896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574213.252216:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747616896:12345-0@lo:400:kworker.0 Request processed in 85us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.252225:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788574213.252250:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574213.252299:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747616896:0@lo:400:kworker.0 00000100:00100000:1.0:1788574213.252956:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616768 00000100:00100000:1.0:1788574213.252963:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616768 00000100:00100000:1.0:1788574213.253017:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788574213.253026:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747616768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574213.253070:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747616768:12345-0@lo:400:kworker.0 Request processed in 46us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.253076:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788574213.253147:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574213.253169:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747616768:0@lo:400:kworker.0 00000100:00100000:2.0:1788574213.254159:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747616512:0@lo:400:kworker.0 00000100:00100000:2.0:1788574213.254207:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574213.254256:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747617024:0@lo:400:kworker.0 00000100:00100000:2.0:1788574213.254282:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574213.254314:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574213.254321:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747616640:0@lo:400:kworker.0 00000100:00100000:0.0:1788574213.254334:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617024 00000100:00100000:0.0:1788574213.254339:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617024 00000100:00100000:2.0:1788574213.254342:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574213.254362:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747617152:0@lo:400:kworker.0 00000100:00100000:0.0:1788574213.254399:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616640 00000100:00100000:0.0:1788574213.254403:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616640 00000100:00100000:2.0:1788574213.254409:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574213.254421:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788574213.254428:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747617024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574213.254437:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788574213.254444:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747616640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574213.254538:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617152 00000100:00100000:3.0:1788574213.254543:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617152 00000100:00100000:3.0:1788574213.254594:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788574213.254602:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747617152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574213.254649:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747616640:12345-0@lo:400:kworker.0 Request processed in 204us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574213.254656:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788574213.254701:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747616512 00000100:00100000:1.0:1788574213.254705:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747616512 00000100:00100000:1.0:1788574213.254733:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788574213.254740:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747616512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574213.262540:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747617024:12345-0@lo:400:kworker.0 Request processed in 8097us (8242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.262569:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788574213.262630:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574213.262638:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574213.267011:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747617152:12345-0@lo:400:kworker.0 Request processed in 12400us (12590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574213.267026:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574213.285855:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747616640:0@lo:400:kworker.0 00010000:00080000:2.0:1788574213.285896:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a72b9180 x1875455747617152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574213.285908:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747617152:0@lo:400:kworker.0 00000100:00100000:1.0:1788574213.289626:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747616512:12345-0@lo:400:kworker.0 Request processed in 33545us (34076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.289650:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788574213.297759:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747616512:0@lo:400:kworker.0 00000100:00100000:2.0:1788574213.297806:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747617024:0@lo:400:kworker.0 00010000:00010000:0.0:1788574213.443778:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574213.760666:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747617280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574213.760747:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574213.764895:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617280 00000100:00100000:3.0:1788574213.764909:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617280 00000100:00100000:3.0:1788574213.764968:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574213.764978:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747617280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574213.765021:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574213.765107:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747617280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (4359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574213.765115:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788574213.765228:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a79e88b800 x1875455747617280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574213.765249:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747617280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788574214.466623:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574215.488637:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574216.335258:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747617408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574216.335332:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574216.335520:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617408 00000100:00100000:1.0:1788574216.335529:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617408 00000100:00100000:1.0:1788574216.335588:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574216.335608:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747617408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574216.335642:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574216.335685:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747617408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574216.335691:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788574216.336188:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574216.336237:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747617408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574216.512703:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574217.003783:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574217.003829:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574217.004083:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657600 00000100:00100000:3.0:1788574217.004298:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657600 00000100:00100000:3.0:1788574217.004362:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 284 00000100:00100000:3.0:1788574217.004413:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727657600:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574217.004488:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727657600:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 79us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574217.004505:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 284 00000100:00100000:3.0:1788574217.004570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574217.004676:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657728 00000100:00100000:3.0:1788574217.004681:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657728 00000100:00100000:3.0:1788574217.004722:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657856 00000100:00100000:3.0:1788574217.004726:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657856 00000100:00100000:3.0:1788574217.004748:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:3.0:1788574217.004756:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727657728:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574217.004790:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727657728:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 35us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574217.004797:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:3.0:1788574217.004808:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:3.0:1788574217.004815:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727657856:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574217.004840:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727657856:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574217.004846:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00080000:3.0:1788574217.004862:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574217.536569:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574218.368714:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747617792:0@lo:400:kworker.0 00000100:00100000:3.0:1788574218.368749:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747617920:0@lo:400:kworker.0 00000100:00100000:2.0:1788574218.368853:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747617536:0@lo:400:kworker.0 00000100:00100000:1.0:1788574218.368917:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747617664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574218.374264:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574218.374411:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617920 00000100:00100000:3.0:1788574218.374433:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617920 00000100:00100000:3.0:1788574218.374507:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574218.374520:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747617920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574218.374599:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747617920:12345-0@lo:400:kworker.0 Request processed in 84us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.374607:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788574218.374634:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574218.374674:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747617920:0@lo:400:kworker.0 00000100:00100000:0.0:1788574218.380089:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574218.385164:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617792 00000100:00100000:3.0:1788574218.385180:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617792 00000100:00100000:3.0:1788574218.385255:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788574218.385267:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747617792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574218.385363:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747617792:12345-0@lo:400:kworker.0 Request processed in 100us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.385387:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788574218.385429:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574218.385483:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747617792:0@lo:400:kworker.0 00000100:00100000:2.0:1788574218.389254:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574218.389328:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747618048:0@lo:400:kworker.0 00000100:00100000:2.0:1788574218.389393:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574218.389443:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618048 00000100:00100000:0.0:1788574218.389475:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618048 00000100:00100000:0.0:1788574218.389544:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574218.389553:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747618048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574218.389620:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747618048:12345-0@lo:400:kworker.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.389628:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788574218.389756:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574218.389787:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747618048:0@lo:400:kworker.0 00000100:00100000:3.0:1788574218.391270:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617536 00000100:00100000:3.0:1788574218.391282:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617536 00000100:00100000:3.0:1788574218.391341:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788574218.391350:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747617536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574218.391447:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747617536:12345-0@lo:400:kworker.0 Request processed in 98us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.391455:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788574218.393444:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747617536:0@lo:400:kworker.0 00000100:00100000:1.0:1788574218.394486:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574218.394541:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747617664 00000100:00100000:1.0:1788574218.394545:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a771b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747618176:0@lo:400:kworker.0 00000100:00100000:0.0:1788574218.394551:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747617664 00000100:00100000:1.0:1788574218.394593:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574218.394621:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788574218.394632:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747617664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574218.394702:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747617664:12345-0@lo:400:kworker.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.394709:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788574218.394853:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618176 00000100:00100000:2.0:1788574218.394858:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618176 00000100:00100000:2.0:1788574218.394906:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574218.394914:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747618176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574218.394963:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747618176:12345-0@lo:400:kworker.0 Request processed in 50us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574218.394969:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788574218.395086:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574218.395502:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747617664:0@lo:400:kworker.0 00010000:00080000:1.0:1788574218.395519:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a771b480 x1875455747618176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574218.395531:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a771b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747618176:0@lo:400:kworker.0 00010000:00010000:0.0:1788574218.560901:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574218.881541:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574218.881568:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747618304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574218.881675:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574218.882002:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618304 00000100:00100000:3.0:1788574218.882013:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618304 00000100:00100000:3.0:1788574218.882077:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788574218.882088:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747618304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574218.882133:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574218.882198:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747618304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.882206:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788574218.883040:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7719c00 x1875455747618304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574218.883072:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747618304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574219.599412:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574220.612135:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574221.446069:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747618432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574221.446191:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574221.446452:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618432 00000100:00100000:1.0:1788574221.446463:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618432 00000100:00100000:1.0:1788574221.446541:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574221.446551:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747618432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574221.446601:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574221.446673:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747618432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574221.446681:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788574221.448468:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574221.448538:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747618432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788574221.639876:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574222.131007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574222.131054:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574222.131103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574222.131427:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727658240 00000100:00100000:0.0:1788574222.131439:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727658240 00000100:00100000:1.0:1788574222.131480:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727657984 00000100:00100000:1.0:1788574222.131486:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727657984 00000100:00100000:0.0:1788574222.131517:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727658112 00000100:00100000:0.0:1788574222.131522:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727658112 00000100:00100000:1.0:1788574222.131533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 286 00000100:00100000:1.0:1788574222.131548:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727657984:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574222.131557:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:0.0:1788574222.131569:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727658240:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574222.131673:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:1.0:1788574222.131679:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727657984:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 134us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574222.131687:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 286 00000100:00100000:2.0:1788574222.131709:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727658112:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:3.0:1788574222.131775:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574222.137522:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727658240:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 5934us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574222.137728:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727658112:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 6020us (6620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574222.137748:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:0.0:1788574222.138428:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 128 00000040:00080000:1.0:1788574222.594920:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574222.657962:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574223.453805:0:11873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:10:21 (1788574221) 00000100:00100000:1.0:1788574223.490448:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747618560:0@lo:400:kworker.0 00000100:00100000:1.0:1788574223.490522:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574223.490574:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747619072:0@lo:400:kworker.0 00000100:00100000:1.0:1788574223.490603:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574223.490630:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788574223.490636:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747618688:0@lo:400:kworker.0 00000100:00100000:1.0:1788574223.490658:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574223.490673:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747619200:0@lo:400:kworker.0 00000100:00100000:1.0:1788574223.490695:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574223.493564:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747618816:0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.493642:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574223.493695:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574223.493702:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747618944:0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.493729:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574223.493768:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618560 00000100:00100000:3.0:1788574223.493777:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618560 00000100:00100000:3.0:1788574223.493828:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788574223.493837:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747618560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.493891:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747618560:12345-0@lo:400:kworker.0 Request processed in 54us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574223.493898:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788574223.493930:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747619072 00000100:00100000:3.0:1788574223.493934:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747619072 00000100:00100000:3.0:1788574223.493966:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618688 00000100:00100000:3.0:1788574223.493970:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618688 00000100:00100000:3.0:1788574223.493987:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618816 00000100:00100000:3.0:1788574223.493990:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618816 00000100:00100000:3.0:1788574223.494006:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788574223.494021:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747619072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494053:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747619072:12345-0@lo:400:kworker.0 Request processed in 33us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574223.494060:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788574223.494073:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788574223.494079:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747618688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494105:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747618688:12345-0@lo:400:kworker.0 Request processed in 27us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574223.494111:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788574223.494121:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788574223.494126:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747618816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494154:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747618816:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574223.494160:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788574223.494181:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747619200 00000100:00100000:3.0:1788574223.494185:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747619200 00000100:00100000:3.0:1788574223.494209:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747618944 00000100:00100000:3.0:1788574223.494212:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747618944 00000100:00100000:3.0:1788574223.494229:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574223.494235:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747619200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494266:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747619200:12345-0@lo:400:kworker.0 Request processed in 31us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574223.494271:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574223.494281:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574223.494286:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747618944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494309:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747618944:12345-0@lo:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574223.494321:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574223.494408:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747618688:0@lo:400:kworker.0 00010000:00080000:3.0:1788574223.494428:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d2d80 x1875455747619200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574223.494440:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747619200:0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494451:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747618560:0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494461:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747619072:0@lo:400:kworker.0 00000100:00080000:3.0:1788574223.494490:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574223.494494:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574223.494497:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574223.494530:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747618944:0@lo:400:kworker.0 00000100:00100000:3.0:1788574223.494540:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747618816:0@lo:400:kworker.0 00010000:00010000:1.0:1788574223.682038:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574224.003014:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747619328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574224.003086:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574224.003212:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747619328 00000100:00100000:0.0:1788574224.003230:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747619328 00000100:00100000:0.0:1788574224.003285:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574224.003295:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747619328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574224.003329:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574224.012049:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747619328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8742us (8950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574224.012066:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788574224.012091:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bd10f100 x1875455747619328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574224.012332:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747619328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788574224.711230:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574224.994550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574224.994619:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727658368 00000100:00100000:3.0:1788574224.994628:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727658368 00000100:00100000:3.0:1788574224.994690:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:3.0:1788574224.994698:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:10220:x1875455727658368:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574224.994714:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574224.994750:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37a5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574224.994801:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535b5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574224.994824:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574224.994834:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574224.994861:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574224.994863:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574224.994903:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574224.994920:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37a5 expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574224.994934:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535b5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37a5 expref: 6 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574224.994940:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574224.994942:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574224.994945:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780031000, rc 0) 00000100:00100000:3.0:1788574224.994997:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:10220:x1875455727658368:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 300us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574224.995004:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00080000:0.0:1788574224.995511:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574225.002265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574225.002565:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727658496 00000100:00100000:2.0:1788574225.002574:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727658496 00000100:00100000:2.0:1788574225.002660:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:2.0:1788574225.002670:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:10221:x1875455727658496:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574225.002689:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574225.002709:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37ac expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.002768:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.002780:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.002791:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.002804:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.002810:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.002816:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003039:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b535b79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003048:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b535b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003055:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b535b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574225.003093:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788574225.003096:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574225.003118:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b535b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003129:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003135:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003141:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003146:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574225.003150:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003156:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003168:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:2.0:1788574225.003176:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574225.003182:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003188:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003201:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003208:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003214:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003219:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574225.003221:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003227:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003234:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a782d70200) 00010000:00010000:2.0:1788574225.003237:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574225.003239:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003305:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b535b72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003338:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b535b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37ac expref: 8 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003416:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b535b79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37ac expref: 7 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.003425:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a782d70600) 00010000:00010000:2.0:1788574225.003427:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574225.003430:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984800, rc 0) 00000100:00100000:2.0:1788574225.003731:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:10221:x1875455727658496:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574225.003739:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:2.0:1788574225.006923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574225.007054:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727658752 00000100:00100000:3.0:1788574225.007064:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727658752 00000100:00100000:3.0:1788574225.007176:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:3.0:1788574225.007186:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:10221:x1875455727658752:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574225.007218:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574225.007238:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535b80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007315:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007328:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007339:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007496:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007505:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007512:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007940:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b535b95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007949:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b535b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.007955:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b535b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574225.007978:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788574225.008122:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008130:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008136:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008142:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574225.008146:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008154:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008862:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574225.008866:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574225.008872:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008878:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535b87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008945:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008951:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008958:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008976:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574225.008979:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008985:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.008994:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a784e37e00) 00010000:00010000:3.0:1788574225.008996:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574225.008998:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.009004:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535b8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.009839:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535b80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37b3 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.009859:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b535b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37b3 expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574225.009867:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574225.009869:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574225.009871:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a400, rc 0) 00000100:00100000:3.0:1788574225.010123:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10221:x1875455727658752:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 2936us (3208us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788574225.010132:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:1.0:1788574225.021790:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574225.021903:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727658880 00000100:00100000:3.0:1788574225.021926:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727658880 00000100:00100000:3.0:1788574225.021986:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:3.0:1788574225.021995:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10221:x1875455727658880:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788574225.022145:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10221:x1875455727658880:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 150us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574225.022152:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000040:00080000:2.0:1788574225.665092:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574225.728734:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574226.560707:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574226.560738:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747619456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574226.560835:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574226.560981:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747619456 00000100:00100000:1.0:1788574226.560991:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747619456 00000100:00100000:1.0:1788574226.561068:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788574226.561080:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747619456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574226.561131:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574226.561192:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747619456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574226.561200:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788574226.561262:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747619456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574226.561345:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788574226.757214:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574227.243670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574227.243730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574227.243766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574227.243867:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659008 00000100:00100000:0.0:1788574227.243880:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659008 00000100:00100000:0.0:1788574227.243954:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 288 00000100:00100000:0.0:1788574227.243966:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727659008:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574227.244047:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727659008:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574227.244055:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 288 00000100:00100000:0.0:1788574227.244090:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659136 00000100:00100000:0.0:1788574227.244094:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659136 00000100:00100000:0.0:1788574227.244143:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659264 00000100:00100000:0.0:1788574227.244146:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659264 00000100:00100000:0.0:1788574227.244191:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:0.0:1788574227.244198:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727659136:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574227.244229:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727659136:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574227.244236:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:0.0:1788574227.244247:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:0.0:1788574227.244254:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727659264:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574227.244276:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2355:x1875455727659264:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 22us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574227.244282:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00080000:0.0:1788574227.244298:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574227.776725:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574228.033673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.033773:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659392 00000100:00100000:3.0:1788574228.033786:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659392 00000100:00100000:3.0:1788574228.033859:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:3.0:1788574228.033871:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10264:x1875455727659392:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574228.033892:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574228.033915:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37ba expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.033987:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034001:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034014:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034028:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034052:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034059:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034315:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034324:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034341:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034347:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574228.034351:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034359:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034407:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574228.034411:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.034416:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034422:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034437:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034449:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034454:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034459:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574228.034463:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034469:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034478:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a784e37e00) 00010000:00010000:3.0:1788574228.034480:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.034483:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034490:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034527:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535ba3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37ba expref: 10 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034536:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574228.034538:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.034542:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37ba expref: 10 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.034561:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b600, rc 0) 00000100:00100000:3.0:1788574228.034624:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10264:x1875455727659392:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 756us (965us total) trans 0 rc 301/301 00000100:00100000:3.0:1788574228.034631:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788574228.069843:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.069965:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659648 00000100:00100000:3.0:1788574228.069977:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659648 00000100:00100000:3.0:1788574228.070033:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:3.0:1788574228.070044:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10264:x1875455727659648:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:3.0:1788574228.070101:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574228.070128:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535b5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37a5 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.070148:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574228.070176:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574228.070431:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.070447:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.070459:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.070473:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.070480:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.070497:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574228.071914:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788574228.071930:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.071940:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.071948:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.071954:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574228.071960:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.071969:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.071984:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:3.0:1788574228.071987:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.071992:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.071998:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574228.072017:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000984fa750 reply state 000000007bcc3ef0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574228.072036:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574228.074597:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:10264:x1875455727659648:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 4535us (4757us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788574228.074615:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00010000:00010000:3.0:1788574228.088284:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.088314:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.088323:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.088338:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574228.088344:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.088353:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.088393:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a784e37400) 00010000:00010000:3.0:1788574228.088397:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.088403:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.088410:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bbf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574228.247664:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574228.248622:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659776 00000100:00100000:0.0:1788574228.248636:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659776 00000100:00100000:0.0:1788574228.248711:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:0.0:1788574228.248721:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10272:x1875455727659776:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:0.0:1788574228.248750:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574228.248775:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.248858:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.248875:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.248901:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574228.248949:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574228.248953:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574228.248999:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.249032:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37c1 expref: 11 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.249052:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37c1 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.249063:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:0.0:1788574228.249065:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574228.249069:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c000, rc 0) 00000100:00100000:0.0:1788574228.249141:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:10272:x1875455727659776:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 421us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574228.249148:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000001:00080000:1.0:1788574228.259676:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:2.0:1788574228.361919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574228.362274:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727659904 00000100:00100000:1.0:1788574228.362287:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727659904 00000100:00100000:1.0:1788574228.362365:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:1.0:1788574228.362404:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:10278:x1875455727659904:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788574228.362429:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574228.362456:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535bd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37c8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.362544:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.362563:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.362601:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.362623:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.362630:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.362636:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363007:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363017:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363023:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574228.363056:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788574228.363060:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574228.363109:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363123:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363130:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363147:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363152:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574228.363157:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363165:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363178:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:1.0:1788574228.363181:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574228.363186:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363193:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363209:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363215:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363221:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363226:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574228.363229:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363245:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363253:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a7b2398000) 00010000:00010000:1.0:1788574228.363255:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574228.363258:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363264:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535be2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363308:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37c8 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363322:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37c8 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.363329:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:1.0:1788574228.363331:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788574228.363334:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21400, rc 0) 00000100:00100000:1.0:1788574228.363434:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10278:x1875455727659904:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1032us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.363442:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:0.0:1788574228.385669:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.385764:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727660160 00000100:00100000:3.0:1788574228.385779:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727660160 00000100:00100000:3.0:1788574228.385879:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:3.0:1788574228.385910:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:10278:x1875455727660160:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574228.385946:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574228.385976:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bf0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37cf expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.386356:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.386427:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.386441:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.386459:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.386466:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.386473:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574228.387311:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788574228.387679:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387693:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387704:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387760:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387767:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387775:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387782:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574228.387787:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387796:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387812:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574228.387815:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.387822:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387829:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535bf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574228.387844:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8823ae4 reply state 00000000f8244391 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574228.387854:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788574228.387898:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535bf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387926:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.387934:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:3.0:1788574228.387937:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574228.387939:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a800, rc 0) 00000100:00100000:3.0:1788574228.388046:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:10278:x1875455727660160:12345-192.168.201.57@tcp:101:bash.0 Request processed in 2144us (2388us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788574228.388056:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00010000:00010000:3.0:1788574228.405942:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.405969:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.405978:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.405985:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574228.406306:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.406319:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.406342:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37a00) 00010000:00010000:3.0:1788574228.406345:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574228.406351:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.406430:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535bfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574228.415474:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.415753:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727660288 00000100:00100000:3.0:1788574228.415768:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727660288 00000100:00100000:3.0:1788574228.415831:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788574228.415842:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875455727660288:12345-192.168.201.57@tcp:8:bash.0 00010000:00080000:3.0:1788574228.415886:0:10306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:3.0:1788574228.415951:0:10306:0:(genops.c:1385:class_connect()) connect: client f540d78c-33c0-4206-a4f5-51879daa7a3f, cookie 0x10531a153b535c13 00002000:00100000:3.0:1788574228.415967:0:10306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f540d78c-33c0-4206-a4f5-51879daa7a3f/ffff90a785311800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574228.416223:0:10306:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574228.416565:0:10306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788574228.416609:0:10306:0:(import.c:65:import_set_state_nolock()) ffff90a785313800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574228.416696:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2352:x1875455727660288:12345-192.168.201.57@tcp:8:bash.0 Request processed in 854us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574228.416705:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574228.424500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.424615:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727660416 00000100:00100000:3.0:1788574228.424629:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727660416 00000100:00100000:3.0:1788574228.424771:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788574228.424782:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:0:x1875455727660416:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574228.424803:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574228.424846:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37d6 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574228.424895:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574228.424946:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1788574228.424951:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574228.424963:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.425001:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.425020:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b800, rc 0) 00000100:00080000:0.0:1788574228.425672:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574228.425980:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:0:x1875455727660416:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1193us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574228.425996:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:2.0:1788574228.436553:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.437202:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727660544 00000100:00100000:3.0:1788574228.437216:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727660544 00000100:00100000:3.0:1788574228.437282:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788574228.437292:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:10278:x1875455727660544:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574228.437322:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574228.437342:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37dd expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.437421:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.437431:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574228.437435:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574228.437441:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.437515:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.437533:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574228.437553:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10306:1875455747619584:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574228.437692:0:10306:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78538b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574228.458595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.458759:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10306:1875455747619584:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574228.458806:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.458835:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a000, rc 0) 00000100:00100000:3.0:1788574228.458911:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:10278:x1875455727660544:12345-192.168.201.57@tcp:101:bash.0 Request processed in 21619us (22376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574228.458922:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574228.459047:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727660672 00000100:00100000:0.0:1788574228.459057:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727660672 00010000:00010000:0.0:1788574228.459115:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574228.459196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:0.0:1788574228.459208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727660672:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574228.459229:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574228.459261:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.459278:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.459334:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e36426c/0x10531a153b535c1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37d6 expref: 8 pid: 6713 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.459351:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574228.459355:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574228.459363:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.459426:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.459471:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574228.459490:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1875455747619712:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574228.459563:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ed7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574228.469348:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1875455747619712:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788574228.469432:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574228.469552:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727660672:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 10344us (10970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574228.469567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:2.0:1788574228.478805:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.478930:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727660928 00000100:00100000:3.0:1788574228.478942:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727660928 00000100:00100000:3.0:1788574228.479015:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574228.479028:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:10278:x1875455727660928:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788574228.479582:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:10278:x1875455727660928:12345-192.168.201.57@tcp:35:bash.0 Request processed in 554us (789us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788574228.479590:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788574228.609146:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747619968:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609254:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574228.609349:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747620480:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609411:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574228.609479:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788574228.609485:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747619840:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609519:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574228.609542:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747620352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609567:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574228.609602:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747619840 00000100:00100000:1.0:1788574228.609614:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747619840 00000100:00100000:1.0:1788574228.609677:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788574228.609688:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747619840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609744:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747619840:12345-0@lo:400:kworker.0 Request processed in 57us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.609752:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788574228.609795:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747619968 00000100:00100000:1.0:1788574228.609799:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747619968 00000100:00100000:1.0:1788574228.609828:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747620352 00000100:00100000:1.0:1788574228.609831:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747620352 00000100:00100000:1.0:1788574228.609863:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574228.609870:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747619968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609921:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747619968:12345-0@lo:400:kworker.0 Request processed in 53us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.609927:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574228.609938:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788574228.609944:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747620352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.609971:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747620352:12345-0@lo:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.609976:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788574228.609996:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574228.610020:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747620480 00000100:00100000:1.0:1788574228.610023:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747620480 00000100:00100000:1.0:1788574228.610059:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788574228.610066:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747620480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.610097:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747620480:12345-0@lo:400:kworker.0 Request processed in 33us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.610103:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788574228.610118:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574228.610146:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747619840:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.610160:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747620352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.610170:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747619968:0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.610180:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747620480:0@lo:400:kworker.0 00000100:00100000:2.0:1788574228.610398:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574228.610437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574228.610460:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574228.610466:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747620224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574228.610487:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574228.610520:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747620224 00000100:00100000:2.0:1788574228.610524:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747620224 00000100:00100000:2.0:1788574228.610557:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574228.610563:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747620224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574228.610613:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747620224:12345-0@lo:400:kworker.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574228.610620:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574228.610649:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747620224:0@lo:400:kworker.0 00000100:00080000:1.0:1788574228.610724:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574228.610736:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747620096 00000100:00100000:1.0:1788574228.610740:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747620096 00000100:00100000:1.0:1788574228.610781:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788574228.610788:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747620096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574228.610824:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747620096:12345-0@lo:400:kworker.0 Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.610830:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788574228.610854:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747620096:0@lo:400:kworker.0 00000100:00080000:2.0:1788574228.611100:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574228.637925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574228.638531:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727661184 00000100:00100000:1.0:1788574228.638550:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727661184 00000100:00100000:1.0:1788574228.638705:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:1.0:1788574228.638720:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:10288:x1875455727661184:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574228.638776:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574228.638807:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37e4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574228.638958:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788574228.639154:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37e4 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.639181:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:1.0:1788574228.639184:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574228.639191:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37e4 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.639213:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574228.639312:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10288:x1875455727661184:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 595us (1417us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788574228.639320:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:0.0:1788574228.649015:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.650797:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727661440 00000100:00100000:3.0:1788574228.650825:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727661440 00000100:00100000:3.0:1788574228.652729:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574228.652765:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10288:x1875455727661440:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574228.653523:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:10288:x1875455727661440:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 768us (4518us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788574228.653536:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00010000:00010000:0.0:1788574228.800589:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574228.813456:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574228.813560:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727661568 00000100:00100000:1.0:1788574228.813575:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727661568 00000100:00100000:1.0:1788574228.813651:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788574228.813665:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:10294:x1875455727661568:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574228.813693:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574228.813718:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37eb expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.813800:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535c3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.813844:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.813857:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574228.813965:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788574228.813969:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574228.813991:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.814017:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37eb expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.814041:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37eb expref: 15 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.814050:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:1.0:1788574228.814053:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574228.814057:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20200, rc 0) 00000100:00100000:1.0:1788574228.814115:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:10294:x1875455727661568:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 453us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574228.814123:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:2.0:1788574228.816782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574228.816883:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727661824 00000100:00100000:0.0:1788574228.817082:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727661824 00000100:00100000:0.0:1788574228.817198:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788574228.817209:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:10294:x1875455727661824:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574228.817228:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574228.817249:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b535c44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37f2 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.817412:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535c4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.817428:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.817440:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574228.817453:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788574228.817628:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b535c44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f2 expref: 18 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.817671:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f2 expref: 17 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.817680:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574228.817684:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574228.817687:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d000, rc 0) 00000100:00100000:0.0:1788574228.817759:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:10294:x1875455727661824:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 551us (985us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788574228.817766:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788574228.822511:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574228.822615:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662080 00000100:00100000:1.0:1788574228.822625:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662080 00000100:00100000:1.0:1788574228.822693:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:1.0:1788574228.822705:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:10294:x1875455727662080:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574228.822737:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574228.822774:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce37f9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.822898:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535c60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.822917:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.822930:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574228.822946:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788574228.823072:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535c59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f9 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.823086:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535c60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f9 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574228.823092:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:1.0:1788574228.823094:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788574228.823096:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21e00, rc 0) 00000100:00100000:1.0:1788574228.823147:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:10294:x1875455727662080:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 445us (652us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788574228.823154:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:2.0:1788574228.824266:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574228.826279:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662208 00000100:00100000:0.0:1788574228.826305:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662208 00000100:00100000:0.0:1788574228.826558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788574228.826570:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:2353:x1875455727662208:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574228.826585:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574228.826618:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f2 expref: 19 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.826637:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574228.826645:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574228.826729:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:2353:x1875455727662208:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 161us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574228.826736:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574228.845186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.845283:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662336 00000100:00100000:3.0:1788574228.845305:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662336 00000100:00100000:3.0:1788574228.845386:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788574228.845399:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727662336:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:3.0:1788574228.845457:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.845483:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.845492:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788574228.845496:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574228.845501:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.845543:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.845558:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 7 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574228.845593:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1875455747620608:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574228.845691:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78538b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574228.849138:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1875455747620608:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574228.849171:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574228.851435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574228.851743:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662464 00000100:00100000:0.0:1788574228.851756:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662464 00002000:00100000:0.0:1788574228.851837:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff90a7bfb0f480 x1875455727662464/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:379/0 lens 504/0 e 0 to 0 dl 1788574239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788574228.851849:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bfb0f480 with x1875455727662464 ext(0->12) 00010000:00010000:0.0:1788574228.851860:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 8 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.851880:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 8 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574228.851903:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a7bfb0f480 00000100:00100000:0.0:1788574228.851937:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788574228.851949:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727662464:12345-192.168.201.57@tcp:4:lfs.0 00000001:00100000:1.0:1788574228.952266:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000100:00100000:3.0:1788574228.957836:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2356:x1875455727662464:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 105863us (106388us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788574228.957862:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00002000:00100000:3.0:1788574228.957880:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff90a7bfb0f480 x1875455727662464/t4294967299(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:379/0 lens 504/448 e 0 to 0 dl 1788574239 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574228.958031:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bfb0f480 with x1875455727662464 ext(0->12) 00010000:00010000:3.0:1788574228.958045:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 9 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.958068:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 9 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574228.958078:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a7bfb0f480 00000100:00100000:2.0:1788574228.975456:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574228.975693:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662592 00000100:00100000:0.0:1788574228.975705:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662592 00010000:00010000:0.0:1788574228.975749:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 9 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574228.975797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788574228.975810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727662592:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574228.975840:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788574228.975864:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788574228.975867:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788574228 00002000:00010000:0.0:1788574228.975870:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788574229 00002000:00010000:0.0:1788574228.975873:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788574228 00010000:00010000:0.0:1788574228.975880:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 9 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.976095:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 9 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.976124:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000129c9b7b/0x10531a153b535c21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37dd expref: 9 pid: 10306 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.976142:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574228.976146:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574228.976152:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.976163:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574228.976196:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574228.976254:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727662592:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 446us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574228.976262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00010000:00010000:3.0:1788574228.976346:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976357:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976424:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976433:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976441:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976448:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574228.976453:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976462:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976473:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.976482:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004586ca36/0x10531a153b535c6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574228.976538:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727662336:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 131142us (131370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574228.976545:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788574228.979595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574228.979672:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662848 00000100:00100000:3.0:1788574228.979686:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662848 00000100:00100000:3.0:1788574228.979745:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788574228.979756:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:10294:x1875455727662848:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:3.0:1788574228.979833:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535c60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f9 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574228.982178:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788574228.982326:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788574228.983709:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788574228.983810:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.983840:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.983850:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.984496:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574228.984518:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 22 pid: 5857 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574228.984539:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1875455747620736:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574228.984691:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bd0f23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574228.993326:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1875455747620736:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574228.993406:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574229.004472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574229.004767:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727662976 00000100:00100000:0.0:1788574229.004782:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727662976 00010000:00010000:0.0:1788574229.004877:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 23 pid: 5857 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574229.004933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:0.0:1788574229.004944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:2355:x1875455727662976:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574229.004969:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574229.004977:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 23 pid: 5857 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.004990:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 23 pid: 5857 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.005013:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37cf expref: 23 pid: 5857 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.005033:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574229.005038:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.005049:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.005058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.005092:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574229.005161:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2355:x1875455727662976:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 219us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574229.005169:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00080000:2.0:1788574229.005414:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574229.005489:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.005498:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574229.005663:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788574229.005880:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788574229.006011:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747620864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574229.006073:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574229.006111:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7812edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574229.006452:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747620864 00000100:00100000:0.0:1788574229.006461:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747620864 00000100:00100000:0.0:1788574229.006511:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574229.006519:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875455747620864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788574229.006615:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875455747620864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574229.006641:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574229.006962:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747620864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788574229.007715:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788574229.007799:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d04700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747620992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574229.007844:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574229.007875:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bd0f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574229.008489:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747620992 00000100:00100000:0.0:1788574229.008500:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747620992 00000100:00100000:0.0:1788574229.008558:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574229.008570:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875455747620992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788574229.008863:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1875455747620992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 293us (1016us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788574229.008872:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574229.012537:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d04700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747620992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788574229.012662:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788574229.012736:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.012747:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.012754:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.012779:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574229.012785:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.012793:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.012813:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:3.0:1788574229.012817:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788574229.012823:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.012829:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535c75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574229.013418:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788574229.013638:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788574229.013650:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355188281111ns, next at 356188278383ns, rc = 0 00000001:00080000:3.0:1788574229.013658:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788574229.013697:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:3.0:1788574229.013700:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788574229.013708:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535c60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37f9 expref: 26 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574229.013837:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+25:10294:x1875455727662848:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 34083us (34254us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788574229.013848:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000020:00080000:3.0:1788574229.013854:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788574229.018266:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574229.018474:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727663104 00000100:00100000:2.0:1788574229.018490:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727663104 00000100:00100000:3.0:1788574229.018675:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:3.0:1788574229.018689:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+25:10294:x1875455727663104:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574229.018730:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574229.018764:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3800 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.018852:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3800 expref: 26 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.018875:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3800 expref: 26 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.018915:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574229.018919:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574229.018925:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b600, rc 0) 00000100:00100000:3.0:1788574229.019304:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:10294:x1875455727663104:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 616us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574229.019312:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:2.0:1788574229.030351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574229.030681:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727663360 00000100:00100000:1.0:1788574229.030713:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727663360 00000100:00100000:1.0:1788574229.030787:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788574229.030798:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785623050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:10294:x1875455727663360:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788574229.031334:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785623050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:10294:x1875455727663360:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 533us (991us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788574229.031343:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574229.121134:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574229.121167:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747621120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574229.121240:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574229.121387:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747621120 00000100:00100000:3.0:1788574229.121395:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747621120 00000100:00100000:3.0:1788574229.121445:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788574229.121456:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875455747621120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574229.121480:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574229.121532:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875455747621120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574229.121539:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788574229.121689:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747621120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574229.231947:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574229.232052:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727663616 00000100:00100000:0.0:1788574229.232062:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727663616 00000100:00100000:0.0:1788574229.232129:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:0.0:1788574229.232141:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:10304:x1875455727663616:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574229.232163:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574229.232184:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3807 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574229.232272:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788574229.232486:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3807 expref: 29 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.232501:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:0.0:1788574229.232505:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574229.232510:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3807 expref: 29 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.232527:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574229.232591:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:10304:x1875455727663616:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 452us (654us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788574229.232598:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:1.0:1788574229.241848:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574229.241984:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727663744 00000100:00100000:0.0:1788574229.241994:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727663744 00000100:00100000:0.0:1788574229.242054:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:0.0:1788574229.242064:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:10304:x1875455727663744:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:0.0:1788574229.242160:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242177:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242189:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242204:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242211:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242217:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242319:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242328:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242334:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574229.242427:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242441:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242447:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242454:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242459:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574229.242464:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242471:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242483:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574229.242486:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574229.242490:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242496:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242509:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242515:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242525:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242530:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574229.242533:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242539:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242545:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a78544fe00) 00010000:00010000:0.0:1788574229.242547:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574229.242550:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242555:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535c98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242568:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242574:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242580:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242584:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574229.242587:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242600:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242606:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:0.0:1788574229.242608:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574229.242611:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574229.242616:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535c9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574229.242686:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:10304:x1875455727663744:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 623us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574229.242694:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788574229.270349:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.270763:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727664000 00000100:00100000:3.0:1788574229.270795:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727664000 00000100:00100000:3.0:1788574229.270882:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788574229.270903:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:10304:x1875455727664000:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574229.271400:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:10304:x1875455727664000:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 498us (1059us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788574229.271409:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574229.357652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.357806:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727664256 00000100:00100000:3.0:1788574229.357825:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727664256 00000100:00100000:3.0:1788574229.357887:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:3.0:1788574229.357898:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:10307:x1875455727664256:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574229.357921:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574229.357942:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535ca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce380e expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358015:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358030:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358041:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358055:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358061:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358066:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358216:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358225:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358232:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574229.358242:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788574229.358342:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358350:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358357:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358363:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574229.358408:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358417:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358429:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574229.358432:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574229.358437:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358453:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358467:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358472:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358478:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358484:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574229.358487:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358493:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358500:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37300) 00010000:00010000:3.0:1788574229.358503:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574229.358506:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358512:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358552:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535ca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 32 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358578:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 31 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.358584:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574229.358586:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574229.358588:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b800, rc 0) 00000100:00100000:3.0:1788574229.359875:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:10307:x1875455727664256:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 763us (1020us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788574229.359889:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:2.0:1788574229.362081:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.362444:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727664384 00000100:00100000:3.0:1788574229.362454:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727664384 00000100:00100000:3.0:1788574229.362505:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:3.0:1788574229.362514:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:10307:x1875455727664384:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788574229.362591:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362607:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362619:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362645:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362652:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362688:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362694:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574229.362699:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362707:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362718:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574229.362721:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574229.362726:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.362733:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574229.362806:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:10307:x1875455727664384:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 292us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574229.362819:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788574229.365192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.365365:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727664640 00000100:00100000:3.0:1788574229.365404:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727664640 00000100:00100000:3.0:1788574229.365457:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574229.365467:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:10307:x1875455727664640:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574229.368469:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:10307:x1875455727664640:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 2989us (3272us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788574229.368483:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00010000:00010000:1.0:1788574229.825509:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574229.861821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.864406:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727664896 00000100:00100000:3.0:1788574229.864428:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727664896 00000100:00100000:3.0:1788574229.864517:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:3.0:1788574229.864529:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:10337:x1875455727664896:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788574229.864559:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574229.864583:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3815 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.864713:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.864729:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.864746:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574229.864759:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788574229.865167:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3815 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.865192:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3815 expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.865203:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574229.865206:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574229.865210:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780030400, rc 0) 00000100:00100000:3.0:1788574229.865303:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10337:x1875455727664896:12345-192.168.201.57@tcp:101:cat.0 Request processed in 776us (3492us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788574229.865327:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:0.0:1788574229.884354:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.884596:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727665152 00000100:00100000:3.0:1788574229.884606:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727665152 00000100:00100000:3.0:1788574229.884668:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574229.884678:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10337:x1875455727665152:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:3.0:1788574229.885320:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:10337:x1875455727665152:12345-192.168.201.57@tcp:35:cat.0 Request processed in 641us (974us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788574229.887295:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:2.0:1788574229.889969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574229.890653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727665280 00000100:00100000:1.0:1788574229.890663:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727665280 00000100:00100000:1.0:1788574229.890730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788574229.890740:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792608050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:2355:x1875455727665280:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574229.890755:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574229.890779:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3815 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574229.890810:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574229.890815:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574229.890870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792608050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:2355:x1875455727665280:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 131us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574229.890885:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:0.0:1788574229.984529:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574229.985142:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727665536 00000100:00100000:3.0:1788574229.985154:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727665536 00000100:00100000:3.0:1788574229.985220:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788574229.985230:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10344:x1875455727665536:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:3.0:1788574229.985263:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574229.985293:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574229.985321:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535c3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37eb expref: 34 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.985352:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574229.985358:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574229.985424:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535ce5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce381c expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.985548:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.985564:0:10109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 34 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.985592:0:10109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.985630:0:10109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 34 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574229.985646:0:10109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 34 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574229.985662:0:10109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747621248:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574229.985787:0:10109:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574230.011012:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574230.011278:0:10109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747621248:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574230.011313:0:10109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574230.011805:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727665664 00000100:00100000:1.0:1788574230.011815:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727665664 00010000:00010000:1.0:1788574230.011871:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 35 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574230.011925:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:1.0:1788574230.011964:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:2356:x1875455727665664:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574230.011983:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574230.011991:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 35 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.012006:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 35 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.012034:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce380e expref: 35 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.012056:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574230.012061:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.012321:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.012331:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.012364:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574230.012486:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:2356:x1875455727665664:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 524us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574230.012494:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00010000:00010000:3.0:1788574230.016030:0:10109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.016059:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574230.016107:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788574230.016686:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535ce5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 35 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.016711:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 34 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.016743:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574230.016746:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574230.016751:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a780031600, rc 0) 00000100:00100000:3.0:1788574230.016844:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10344:x1875455727665536:12345-192.168.201.57@tcp:101:dd.0 Request processed in 31613us (32327us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788574230.016854:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:2.0:1788574230.029756:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574230.029898:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727665920 00000100:00100000:0.0:1788574230.029914:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727665920 00000100:00100000:0.0:1788574230.029984:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:0.0:1788574230.029995:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10344:x1875455727665920:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:0.0:1788574230.030352:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574230.030589:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574230.030605:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574230.030690:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788574230.030717:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ac1c5c7 reply state 00000000fe3d7d5b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574230.030727:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574230.031417:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:10344:x1875455727665920:12345-192.168.201.57@tcp:36:dd.0 Request processed in 1417us (1667us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788574230.031428:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000020:00080000:0.0:1788574230.031435:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788574230.049089:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.049109:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.049140:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.049146:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574230.049151:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.049159:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.049175:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574230.049178:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574230.049183:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574230.049189:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535cfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574230.591435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574230.591569:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727666048 00000100:00100000:3.0:1788574230.591580:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727666048 00000100:00100000:3.0:1788574230.591654:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:3.0:1788574230.591666:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+36:10358:x1875455727666048:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:3.0:1788574230.591694:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574230.591716:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3823 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591821:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591837:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591850:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591865:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591873:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591902:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591987:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.591999:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 37 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.592008:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.592042:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 37 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.592056:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 37 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574230.592071:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747621376:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574230.592630:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574230.608858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574230.609005:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727666304 00000100:00100000:1.0:1788574230.609015:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727666304 00000100:00100000:1.0:1788574230.609090:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574230.609101:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:5592:x1875455727666304:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788574230.609520:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:5592:x1875455727666304:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 419us (672us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788574230.609530:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788574230.610229:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747621376:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574230.610255:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574230.615502:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574230.615735:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727666432 00000100:00100000:2.0:1788574230.615747:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727666432 00010000:00010000:2.0:1788574230.615795:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 39 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574230.615833:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:2.0:1788574230.615842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:2355:x1875455727666432:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574230.615860:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574230.615877:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 39 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574230.615892:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 39 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574230.615915:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031600/0x10531a153b535cec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce381c expref: 39 pid: 10109 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574230.615935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:2.0:1788574230.615939:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574230.615949:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574230.615957:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574230.616006:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574230.616302:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616311:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574230.616409:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788574230.616414:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574230.616470:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616486:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616496:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616503:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616509:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616514:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574230.616518:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616525:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616535:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574230.616538:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574230.616542:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616548:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031400/0x10531a153b535d08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616572:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616578:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616584:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616589:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574230.616592:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616598:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616605:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37300) 00010000:00010000:3.0:1788574230.616608:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574230.616610:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616615:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780030400/0x10531a153b535d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616654:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a780031000/0x10531a153b535d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3823 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616669:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3823 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.616687:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574230.616689:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574230.616691:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b800, rc 0) 00000100:00100000:2.0:1788574230.616897:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:2355:x1875455727666432:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 1054us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574230.616906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788574230.618397:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:10358:x1875455727666048:12345-192.168.201.57@tcp:101:stat.0 Request processed in 26724us (26963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574230.618407:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788574230.754717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574230.754826:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727666688 00000100:00100000:3.0:1788574230.754841:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727666688 00000100:00100000:3.0:1788574230.754931:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:3.0:1788574230.754943:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:10364:x1875455727666688:12345-192.168.201.57@tcp:36:truncate.0 00010000:00010000:3.0:1788574230.755013:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574230.755064:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3823 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.755090:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574230.755095:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574230.755635:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.755651:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.755662:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574230.755716:0:10109:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788574230.755741:0:10109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088bc8a68 reply state 00000000cc32cde1 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574230.755757:0:10109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574230.755867:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:10364:x1875455727666688:12345-192.168.201.57@tcp:36:truncate.0 Request processed in 924us (1161us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788574230.755874:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000020:00080000:3.0:1788574230.755879:0:10109:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574230.767576:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.767597:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.767604:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.767610:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574230.767615:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.767623:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.767642:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574230.767645:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574230.767650:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.767656:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574230.848675:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574231.089105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.089397:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727666816 00000100:00100000:1.0:1788574231.089406:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727666816 00000100:00100000:1.0:1788574231.089485:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788574231.089497:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:10378:x1875455727666816:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:1.0:1788574231.089542:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574231.089567:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce382a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089644:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089657:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089668:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089681:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089688:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089695:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089774:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089791:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.089797:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574231.089827:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788574231.089835:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:2.0:1788574231.090085:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1788574231.090130:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090143:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090151:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090157:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090165:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090171:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574231.090175:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090183:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090193:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:1.0:1788574231.090196:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574231.090201:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090207:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090220:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090236:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090242:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090247:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574231.090260:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090266:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090273:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a7b2398200) 00010000:00010000:1.0:1788574231.090276:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574231.090278:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090285:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090316:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 40 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090328:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 39 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.090334:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574231.090336:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574231.090343:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20800, rc 0) 00000100:00100000:1.0:1788574231.090585:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:10378:x1875455727666816:12345-192.168.201.57@tcp:101:stat.0 Request processed in 1090us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.090593:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:2.0:1788574231.209812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.209964:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727667072 00000100:00100000:3.0:1788574231.209977:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727667072 00000100:00100000:3.0:1788574231.210042:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:3.0:1788574231.210052:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:10388:x1875455727667072:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574231.210074:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574231.210100:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3831 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.210206:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788574231.210349:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3831 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.210405:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:3.0:1788574231.210409:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574231.210416:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3831 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.210434:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a200, rc 0) 00000100:00100000:3.0:1788574231.210511:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:10388:x1875455727667072:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 459us (708us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788574231.210518:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:2.0:1788574231.213420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.213533:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727667328 00000100:00100000:1.0:1788574231.213545:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727667328 00000100:00100000:1.0:1788574231.213612:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788574231.213624:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:10388:x1875455727667328:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788574231.213991:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:10388:x1875455727667328:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 368us (623us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788574231.213999:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788574231.296621:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.296873:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727667584 00000100:00100000:3.0:1788574231.296884:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727667584 00000100:00100000:3.0:1788574231.296948:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:3.0:1788574231.296959:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:10394:x1875455727667584:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574231.296986:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574231.297008:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3838 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.297117:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.297131:0:10109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 42 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.297140:0:10109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.297173:0:10109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 42 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.297186:0:10109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 42 pid: 5859 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574231.297199:0:10109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747621504:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574231.297749:0:10109:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a791f80900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574231.300387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.301468:0:10109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747621504:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574231.301498:0:10109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574231.301584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727667712 00000100:00100000:0.0:1788574231.301593:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727667712 00010000:00010000:0.0:1788574231.302182:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 43 pid: 5859 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574231.302229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:0.0:1788574231.302240:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:2356:x1875455727667712:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574231.302265:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574231.302272:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 43 pid: 5859 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.302285:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 43 pid: 5859 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.302308:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b535d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce382a expref: 43 pid: 5859 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.302490:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:0.0:1788574231.302496:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.302506:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.302514:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.303182:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574231.303259:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:2356:x1875455727667712:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 1009us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574231.303269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00010000:00010000:3.0:1788574231.308462:0:10109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.308482:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.308509:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788574231.308772:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 43 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.308880:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 42 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.308888:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574231.308891:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574231.308895:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a200, rc 0) 00000100:00100000:3.0:1788574231.309023:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:10394:x1875455727667584:12345-192.168.201.57@tcp:101:bash.0 Request processed in 12065us (12410us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788574231.309033:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:2.0:1788574231.334239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.334345:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727667968 00000100:00100000:1.0:1788574231.334355:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727667968 00000100:00100000:1.0:1788574231.334453:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:1.0:1788574231.334464:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:10394:x1875455727667968:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:1.0:1788574231.334736:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.334755:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.334767:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574231.334847:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788574231.334872:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d248dd3d reply state 00000000c294dc5a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574231.334880:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574231.334969:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:10394:x1875455727667968:12345-192.168.201.57@tcp:36:bash.0 Request processed in 506us (738us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788574231.334977:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000020:00080000:1.0:1788574231.334982:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788574231.339053:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.339070:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.339076:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.339081:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574231.339086:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.339094:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.339121:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574231.339125:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574231.339129:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.339305:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535d63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574231.341777:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574231.341870:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727668096 00000100:00100000:0.0:1788574231.341881:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727668096 00000100:00100000:0.0:1788574231.341940:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:0.0:1788574231.341950:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+44:10394:x1875455727668096:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574231.341974:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574231.341995:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce383f expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.342094:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.342110:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 45 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.342152:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.342188:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 45 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.342202:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 45 pid: 10109 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574231.342216:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747621632:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574231.342314:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ed76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574231.344785:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747621632:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574231.344822:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574231.345844:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574231.352428:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727668224 00000100:00100000:0.0:1788574231.352450:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727668224 00010000:00010000:0.0:1788574231.352512:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 46 pid: 10109 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574231.352553:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:0.0:1788574231.352563:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:2355:x1875455727668224:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574231.352579:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574231.352586:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 46 pid: 10109 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.352635:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 46 pid: 10109 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.352661:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535d55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3838 expref: 46 pid: 10109 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.352681:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:0.0:1788574231.352688:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.352699:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.352706:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.352747:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574231.352824:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:2355:x1875455727668224:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 262us (6988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574231.352832:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00010000:00010000:3.0:1788574231.353944:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.353957:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.354011:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788574231.354016:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574231.354039:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.354076:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce383f expref: 45 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.354093:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce383f expref: 44 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.354101:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574231.354123:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574231.354127:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d800, rc 0) 00000100:00100000:3.0:1788574231.354180:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+44:10394:x1875455727668096:12345-192.168.201.57@tcp:101:bash.0 Request processed in 12231us (12412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.354188:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:2.0:1788574231.356999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.357074:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727668480 00000100:00100000:1.0:1788574231.357086:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727668480 00000100:00100000:1.0:1788574231.357180:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788574231.357193:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785622850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+44:10394:x1875455727668480:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:1.0:1788574231.357910:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785622850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:10394:x1875455727668480:12345-192.168.201.57@tcp:35:bash.0 Request processed in 714us (917us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788574231.357920:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:2.0:1788574231.502758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.502863:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727668736 00000100:00100000:3.0:1788574231.502875:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727668736 00000100:00100000:3.0:1788574231.502953:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:3.0:1788574231.502965:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:10404:x1875455727668736:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574231.502995:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574231.503022:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3846 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.503123:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788574231.503296:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3846 expref: 47 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.503311:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:3.0:1788574231.503314:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574231.503319:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3846 expref: 47 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.503335:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b800, rc 0) 00000100:00100000:3.0:1788574231.503469:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:10404:x1875455727668736:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 505us (721us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788574231.503476:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:0.0:1788574231.509599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.509695:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727668864 00000100:00100000:3.0:1788574231.509719:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727668864 00000100:00100000:3.0:1788574231.509779:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:3.0:1788574231.509789:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:10404:x1875455727668864:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788574231.509864:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.509880:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.509891:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.509905:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.509912:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.509919:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510000:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510010:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510017:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574231.510055:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510078:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510085:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510091:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510096:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.510099:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510107:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510120:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574231.510123:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.510127:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510152:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535d86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510165:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510170:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510175:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510185:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.510188:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510194:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510202:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37300) 00010000:00010000:3.0:1788574231.510204:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.510207:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510213:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510227:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510233:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510237:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510252:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.510255:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510260:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510280:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574231.510283:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.510286:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.510291:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574231.510362:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:10404:x1875455727668864:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 573us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.510448:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:2.0:1788574231.517547:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.517635:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727669120 00000100:00100000:3.0:1788574231.517645:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727669120 00000100:00100000:3.0:1788574231.517707:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788574231.517717:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:10404:x1875455727669120:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574231.517957:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:10404:x1875455727669120:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 241us (419us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788574231.517965:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788574231.596698:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.596846:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727669376 00000100:00100000:3.0:1788574231.596856:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727669376 00000100:00100000:3.0:1788574231.597939:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:3.0:1788574231.597956:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:10407:x1875455727669376:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574231.597981:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574231.598002:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce384d expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598073:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598111:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598123:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598139:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598146:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598152:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598498:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598508:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598515:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.598526:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788574231.598643:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598651:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598657:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598669:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.598674:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598682:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598693:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574231.598696:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.598701:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598708:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535da2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598722:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598732:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598738:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598742:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.598745:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598751:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598768:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37300) 00010000:00010000:3.0:1788574231.598883:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.598888:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598895:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535da9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598940:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535d9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce384d expref: 50 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598954:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce384d expref: 49 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.598961:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574231.598964:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574231.598966:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a200, rc 0) 00000100:00100000:3.0:1788574231.599093:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10407:x1875455727669376:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1142us (2402us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788574231.599109:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:0.0:1788574231.604339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574231.604410:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.604521:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727669504 00000100:00100000:3.0:1788574231.604534:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727669504 00000100:00100000:3.0:1788574231.604605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788574231.604618:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:2356:x1875455727669504:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574231.604636:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574231.604664:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce384d expref: 49 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.604705:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574231.604710:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574231.604771:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:2356:x1875455727669504:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 155us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.604790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788574231.605540:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727669632 00000100:00100000:1.0:1788574231.605550:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727669632 00000100:00100000:1.0:1788574231.605597:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:1.0:1788574231.605606:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:10407:x1875455727669632:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788574231.605680:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605698:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605711:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605742:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605748:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605754:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605786:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574231.605793:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605804:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605815:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574231.605819:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574231.605824:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.605831:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574231.605905:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:10407:x1875455727669632:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 299us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.605913:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:0.0:1788574231.609992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.610067:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727669888 00000100:00100000:3.0:1788574231.610077:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727669888 00000100:00100000:3.0:1788574231.610131:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574231.610140:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:10407:x1875455727669888:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574231.610497:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10407:x1875455727669888:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 356us (515us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788574231.610505:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574231.680985:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574231.681012:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747621760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574231.681096:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574231.681332:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747621760 00000100:00100000:1.0:1788574231.681345:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747621760 00000100:00100000:1.0:1788574231.681456:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574231.681470:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747621760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574231.681518:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574231.681578:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747621760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.681586:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574231.681642:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747621760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788574231.681756:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574231.796630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.796738:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727670144 00000100:00100000:1.0:1788574231.796760:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727670144 00000100:00100000:1.0:1788574231.796837:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:1.0:1788574231.796847:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10425:x1875455727670144:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:1.0:1788574231.796871:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574231.796891:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3854 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.796985:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535dcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.797000:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.797012:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574231.797023:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788574231.797171:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3854 expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.797191:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535dcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3854 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.797199:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574231.797202:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788574231.797215:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21e00, rc 0) 00000100:00100000:1.0:1788574231.797329:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10425:x1875455727670144:12345-192.168.201.57@tcp:101:cat.0 Request processed in 482us (709us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788574231.797336:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00010000:00010000:0.0:1788574231.873100:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574231.886298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.886457:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727670272 00000100:00100000:3.0:1788574231.886468:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727670272 00000100:00100000:3.0:1788574231.886537:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:3.0:1788574231.886548:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10426:x1875455727670272:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574231.886573:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574231.886592:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce385b expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.886661:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.886686:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.886697:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.886733:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788574231.886736:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574231.886752:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.886948:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce385b expref: 53 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.886979:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce385b expref: 52 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.886987:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574231.886991:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574231.886995:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a800, rc 0) 00000100:00100000:3.0:1788574231.887303:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10426:x1875455727670272:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 756us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.887311:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:0.0:1788574231.908668:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.909915:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727670656 00000100:00100000:3.0:1788574231.909928:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727670656 00000100:00100000:3.0:1788574231.910123:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788574231.910134:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10426:x1875455727670656:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574231.911218:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10426:x1875455727670656:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 1072us (2553us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788574231.911232:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788574231.914796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574231.914925:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727670784 00000100:00100000:1.0:1788574231.914934:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727670784 00000100:00100000:1.0:1788574231.915557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788574231.915571:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10426:x1875455727670784:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:1.0:1788574231.915588:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788574231.915614:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce383f expref: 53 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.915637:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3854 expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.915650:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3800 expref: 51 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574231.915661:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:1.0:1788574231.915672:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574231.915737:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:10426:x1875455727670784:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 169us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.915745:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574231.918738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.920951:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727670912 00000100:00100000:3.0:1788574231.920995:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727670912 00000100:00100000:3.0:1788574231.921076:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:3.0:1788574231.921086:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:10426:x1875455727670912:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:3.0:1788574231.921208:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.921225:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.921265:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574231.921605:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574231.923394:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788574231.923574:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788574231.923764:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:10426:x1875455727670912:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 2671us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.923781:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:2.0:1788574231.978880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574231.979073:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671040 00000100:00100000:3.0:1788574231.979085:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671040 00000100:00100000:3.0:1788574231.979305:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:3.0:1788574231.979316:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:10428:x1875455727671040:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574231.979337:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574231.979360:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535def lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3862 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979501:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979516:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979536:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979553:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979560:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979566:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979655:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979663:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979670:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574231.979701:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788574231.979705:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574231.979724:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979735:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979743:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979759:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979766:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979773:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.979777:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979784:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979795:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574231.979798:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.979815:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979822:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b535df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979835:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979841:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979846:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979852:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574231.979860:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979866:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979875:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37900) 00010000:00010000:3.0:1788574231.979877:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574231.979880:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979885:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b600/0x10531a153b535dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979916:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b535def lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 52 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979928:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 51 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574231.979934:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:3.0:1788574231.979936:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574231.979938:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6000, rc 0) 00000100:00100000:3.0:1788574231.980225:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10428:x1875455727671040:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 910us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.980242:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:2.0:1788574232.365270:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574232.365318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574232.365350:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574232.365419:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671424 00000100:00100000:2.0:1788574232.365429:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671424 00000100:00100000:2.0:1788574232.365497:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 138 00000100:00100000:2.0:1788574232.365507:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727671424:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574232.365588:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727671424:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574232.365596:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 138 00000100:00080000:2.0:1788574232.365621:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574232.365909:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671296 00000100:00100000:0.0:1788574232.365915:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671296 00000100:00100000:0.0:1788574232.365972:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:0.0:1788574232.365979:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727671296:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574232.366012:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727671296:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 34us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574232.366019:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:3.0:1788574232.366942:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671168 00000100:00100000:3.0:1788574232.366951:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671168 00000100:00100000:3.0:1788574232.367042:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 290 00000100:00100000:3.0:1788574232.367050:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727671168:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574232.367103:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727671168:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 54us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574232.367110:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 290 00000100:00080000:2.0:1788574232.368694:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788574232.832858:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574232.832873:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574232.832958:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788574232.832966:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574232.833142:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747621888:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574232.833264:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ed7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574232.858824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574232.858871:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671552 00000100:00100000:0.0:1788574232.858880:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671552 00000100:00100000:0.0:1788574232.858931:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:0.0:1788574232.858943:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727671552:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788574232.859024:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727671552:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574232.859032:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788574232.859296:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747621888:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574232.877962:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574232.878078:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671680 00000100:00100000:3.0:1788574232.878097:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671680 00000100:00100000:3.0:1788574232.878151:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:3.0:1788574232.878161:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10440:x1875455727671680:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574232.878197:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574232.878328:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10440:x1875455727671680:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 167us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574232.878335:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00010000:00010000:0.0:1788574232.896997:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574232.905690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574232.905742:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727671808 00000100:00100000:3.0:1788574232.909531:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727671808 00000100:00100000:3.0:1788574232.909637:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788574232.909647:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10440:x1875455727671808:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788574232.909728:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909833:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909848:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909912:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909935:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909943:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909976:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909984:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.909991:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574232.910034:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788574232.910039:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574232.910052:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910064:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910071:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910077:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910083:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574232.910087:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910101:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910113:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574232.910116:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574232.910120:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910127:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910143:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910150:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910156:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910160:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574232.910163:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910169:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910176:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff90a784e37900) 00010000:00010000:3.0:1788574232.910178:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574232.910181:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910197:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910213:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910230:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910236:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910241:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574232.910245:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910251:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910259:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:3.0:1788574232.910261:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574232.910264:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.910269:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574232.910357:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10440:x1875455727671808:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 710us (4681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574232.910365:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:2.0:1788574232.914648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574232.921250:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727672064 00000100:00100000:0.0:1788574232.921263:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727672064 00000100:00100000:0.0:1788574232.921860:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:0.0:1788574232.921872:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10440:x1875455727672064:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574232.921892:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574232.921914:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535e20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3869 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922021:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922036:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922047:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574232.922058:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788574232.922160:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922169:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922176:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922182:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574232.922185:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922192:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922204:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574232.922207:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574232.922212:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922239:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922280:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535e20 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3869 expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922291:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:0.0:1788574232.922293:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574232.922298:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535e20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3869 expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.922307:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c800, rc 0) 00000100:00100000:0.0:1788574232.922401:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727672064:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 532us (7767us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788574232.922409:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:2.0:1788574232.932817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574232.932952:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727672192 00000100:00100000:0.0:1788574232.932964:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727672192 00000100:00100000:0.0:1788574232.933027:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:0.0:1788574232.933038:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727672192:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574232.933073:0:5859:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574232.933197:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727672192:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 160us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574232.933206:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:2.0:1788574232.957153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574232.957901:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727672448 00000100:00100000:3.0:1788574232.957914:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727672448 00000100:00100000:3.0:1788574232.957981:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:3.0:1788574232.957992:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727672448:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574232.958013:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574232.958017:0:11654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574232.958047:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a800/0x10531a153b535de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce385b expref: 52 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.958064:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574232.958070:0:11654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574232.959549:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3870 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574232.962581:0:11654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788574232.963306:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574232.963326:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574232.963338:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574232.964038:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b535e35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3870 expref: 54 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574232.964078:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3870 expref: 53 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574232.964096:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a782d70500) 00010000:00010000:2.0:1788574232.964100:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574232.964103:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984e00, rc 0) 00000100:00100000:2.0:1788574232.964172:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10440:x1875455727672448:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 6181us (7028us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788574232.964181:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:0.0:1788574232.972432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574232.972484:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727672704 00000100:00100000:0.0:1788574232.972495:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727672704 00000100:00100000:0.0:1788574232.972557:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:0.0:1788574232.972567:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10440:x1875455727672704:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574232.972630:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574232.972659:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3870 expref: 53 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972676:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a782d70500) 00010000:00010000:0.0:1788574232.972687:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574232.972710:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972724:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972735:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972790:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972797:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972804:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972869:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972876:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972892:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972898:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574232.972902:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972909:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972917:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574232.972920:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574232.972923:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972930:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535e4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972940:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972946:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972953:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972958:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574232.972962:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972979:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972987:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x44830218 (ffff90a78544f300) 00010000:00010000:0.0:1788574232.972989:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574232.972992:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574232.972997:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535e51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x44830218 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574232.973069:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727672704:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 504us (649us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574232.973076:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:1.0:1788574232.981765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574232.981931:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727672832 00000100:00100000:3.0:1788574232.981942:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727672832 00000100:00100000:3.0:1788574232.982011:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:3.0:1788574232.982023:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10440:x1875455727672832:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574232.982048:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574232.982071:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3877 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.982118:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.982132:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.982144:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.982261:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 54 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.982287:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 53 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574232.982297:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574232.982300:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574232.982304:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7200, rc 0) 00000100:00100000:3.0:1788574232.982401:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10440:x1875455727672832:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 380us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574232.982408:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:2.0:1788574232.985822:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574232.985921:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727673088 00000100:00100000:1.0:1788574232.985933:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727673088 00000100:00100000:1.0:1788574232.986011:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:1.0:1788574232.986030:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10440:x1875455727673088:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574232.986265:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574232.986283:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574232.986302:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574232.988194:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788574232.988235:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359162865078ns, next at 360162859418ns, rc = 0 00000004:00010000:1.0:1788574232.988388:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c1fdecf reply state 0000000049dc02c8 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574232.988402:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574232.988554:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10440:x1875455727673088:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 2529us (2738us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788574232.988563:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:1.0:1788574233.002834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:0.0:1788574233.002980:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.002999:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003008:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003023:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574233.003031:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003048:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003270:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:0.0:1788574233.003274:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788574233.003279:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003286:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535e66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.003323:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727673216 00000100:00100000:0.0:1788574233.003337:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727673216 00000100:00100000:0.0:1788574233.003514:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:0.0:1788574233.003527:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10440:x1875455727673216:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574233.003558:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574233.003584:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce387e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003673:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003690:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.003711:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:0.0:1788574233.003714:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574233.003717:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d800, rc 0) 00000100:00100000:0.0:1788574233.003792:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10440:x1875455727673216:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 268us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574233.003810:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00080000:1.0:1788574233.007179:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574233.012981:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574233.013030:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727673344 00000100:00100000:1.0:1788574233.013041:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727673344 00000100:00100000:1.0:1788574233.013258:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:1.0:1788574233.013268:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875455727673344:12345-192.168.201.57@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788574233.013299:0:6713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:1.0:1788574233.013331:0:6713:0:(genops.c:1385:class_connect()) connect: client f540d78c-33c0-4206-a4f5-51879daa7a3f, cookie 0x10531a153b535e74 00002000:00100000:1.0:1788574233.013343:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f540d78c-33c0-4206-a4f5-51879daa7a3f/ffff90a791da7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788574233.013387:0:6713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788574233.013627:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788574233.013657:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574233.013720:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2352:x1875455727673344:12345-192.168.201.57@tcp:8:lhsmtool_posix.0 Request processed in 452us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574233.013732:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788574233.018955:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.018988:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727673472 00000100:00100000:3.0:1788574233.018998:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727673472 00000100:00100000:3.0:1788574233.019055:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788574233.019065:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:0:x1875455727673472:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788574233.019322:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788574233.027294:0:12023:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574233.027303:0:12023:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574233.027340:0:12023:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788574233.027346:0:12023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574233.087884:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:0:x1875455727673472:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 68811us (68929us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788574233.087898:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000001:00100000:2.0:1788574233.087933:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000001:00080000:2.0:1788574233.087947:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1788574233.090973:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.091052:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727673728 00000100:00100000:3.0:1788574233.091062:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727673728 00000100:00100000:3.0:1788574233.091124:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788574233.091135:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10440:x1875455727673728:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788574233.091429:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10440:x1875455727673728:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 294us (467us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788574233.091438:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:2.0:1788574233.093565:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.093671:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727673984 00000100:00100000:3.0:1788574233.093682:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727673984 00000100:00100000:3.0:1788574233.093758:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:3.0:1788574233.093784:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10440:x1875455727673984:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788574233.093918:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10440:x1875455727673984:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 137us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574233.093926:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:1.0:1788574233.099065:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.099148:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727674112 00000100:00100000:3.0:1788574233.099159:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727674112 00000100:00100000:3.0:1788574233.099257:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:3.0:1788574233.099267:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10440:x1875455727674112:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574233.099287:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574233.099307:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3885 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.099411:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.099426:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.099438:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574233.099473:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574233.099490:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.099515:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b535e7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3885 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.099531:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3885 expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.099546:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574233.099549:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788574233.099553:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574233.099609:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10440:x1875455727674112:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 344us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574233.099616:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:2.0:1788574233.105629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.105711:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727674240 00000100:00100000:3.0:1788574233.105723:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727674240 00000100:00100000:3.0:1788574233.105786:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:3.0:1788574233.105797:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727674240:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574233.105816:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574233.105837:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce388c expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574233.105864:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a19, blocks: 0x1 00010000:00010000:3.0:1788574233.105885:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788574233.105889:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574233.105898:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 6 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.105920:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 6 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.105935:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6800, rc 0) 00000100:00100000:3.0:1788574233.106001:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727674240:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 206us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574233.106008:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:1.0:1788574233.115192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.115264:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727674496 00000100:00100000:3.0:1788574233.115274:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727674496 00000100:00100000:3.0:1788574233.115328:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788574233.115339:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10440:x1875455727674496:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788574233.115458:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10440:x1875455727674496:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 120us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574233.115466:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:1.0:1788574233.120730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.120905:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727674624 00000100:00100000:3.0:1788574233.120917:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727674624 00000100:00100000:3.0:1788574233.120991:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:3.0:1788574233.121002:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:10440:x1875455727674624:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574233.121031:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574233.121285:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3893 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.121325:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.121337:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574233.121342:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574233.121348:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.121661:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.121676:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574233.121691:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10306:1875455747622016:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574233.121788:0:10306:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574233.127648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574233.127735:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10306:1875455747622016:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574233.127763:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.127781:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7000, rc 0) 00000100:00100000:0.0:1788574233.127833:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:10440:x1875455727674624:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 6834us (7113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574233.127841:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:0.0:1788574233.127881:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727674752 00000100:00100000:0.0:1788574233.127886:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727674752 00010000:00010000:0.0:1788574233.127914:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.127944:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:0.0:1788574233.127954:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792609c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727674752:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574233.127969:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574233.127995:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.128008:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.128032:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b535e89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce388c expref: 7 pid: 6713 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.128051:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574233.128055:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574233.128064:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 6 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.128073:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 6 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.128120:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 6 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.128136:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792339f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1875455747622144:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574233.128183:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792212180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574233.131272:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792339f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1875455747622144:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788574233.131297:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574233.131357:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792609c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727674752:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 3402us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574233.131391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:2.0:1788574233.133726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.134771:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727674880 00000100:00100000:3.0:1788574233.134783:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727674880 00002000:00100000:3.0:1788574233.134896:0:6719:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90a7a70efb80 x1875455727674880/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:384/0 lens 504/0 e 0 to 0 dl 1788574244 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574233.134908:0:6719:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a70efb80 with x1875455727674880 ext(0->8) 00002000:00010000:3.0:1788574233.134914:0:6719:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7a70efb80 00000100:00100000:2.0:1788574233.134950:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788574233.134962:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727674880:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788574233.135942:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727674880:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 979us (2220us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788574233.135951:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00002000:00100000:2.0:1788574233.135958:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90a7a70efb80 x1875455727674880/t4294967302(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:384/0 lens 504/448 e 0 to 0 dl 1788574244 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574233.135967:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a70efb80 with x1875455727674880 ext(0->8) 00002000:00010000:2.0:1788574233.135971:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7a70efb80 00000100:00100000:2.0:1788574233.137652:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.137731:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727675008 00000100:00100000:3.0:1788574233.137739:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727675008 00000100:00100000:3.0:1788574233.137797:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:3.0:1788574233.137807:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10440:x1875455727675008:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788574233.203530:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10440:x1875455727675008:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 65713us (65875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574233.203543:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00000001:00080000:0.0:1788574233.205657:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1788574233.205683:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788574233.205687:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:0.0:1788574233.205733:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788574233.205767:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788574233.205789:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a78538b000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788574233.205795:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a79e962900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a78538b300 00000020:00080000:0.0:1788574233.205798:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a79e962d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a79218d400 00000020:00080000:0.0:1788574233.205944:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788574233.206469:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788574233.206496:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747622272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788574233.206578:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574233.206642:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574233.206648:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747622400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788574233.206671:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574233.206703:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747622272 00000100:00100000:0.0:1788574233.206710:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747622272 00000100:00100000:0.0:1788574233.206768:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747622400 00000100:00100000:0.0:1788574233.206772:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747622400 00000100:00100000:0.0:1788574233.206800:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574233.206808:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747622272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788574233.206840:0:6713:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788574233.206882:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b7a14, atime: 0x6a9b7a15, ctime: 0x6a9b7a14, blocks: 0x1 00010000:00010000:0.0:1788574233.206892:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.206914:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1788574233.206920:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574233.206927:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.206968:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.206980:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.206988:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.207008:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788574233.207607:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875455747622272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 797us (1026us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788574233.207615:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574233.207633:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574233.207641:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747622400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788574233.207743:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788574233.207747:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788574233 00002000:00010000:0.0:1788574233.207749:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788574233.207751:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788574233 -> 1788574233 00002000:00010000:0.0:1788574233.207753:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788574233.207779:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747622400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (1106us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788574233.207785:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788574233.207809:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574233.207813:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788574233.207836:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574233.207842:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.207852:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574233.207857:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.207866:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.207884:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.207891:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b535e97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.207907:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574233.207909:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574233.207911:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788574233.207954:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a791d05c00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788574233.207959:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747622400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788574233.207969:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a792339f80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788574233.207973:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747622272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788574233.208517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574233.208549:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727675136 00000100:00100000:1.0:1788574233.208557:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727675136 00000100:00100000:1.0:1788574233.208593:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:1.0:1788574233.208601:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727675136:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788574233.246130:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727675136:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 37516us (37602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574233.246144:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000001:00080000:3.0:1788574233.246185:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788574233.246208:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788574233.251898:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.252273:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727675392 00000100:00100000:3.0:1788574233.252284:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727675392 00000100:00100000:3.0:1788574233.252347:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:3.0:1788574233.252359:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10440:x1875455727675392:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574233.252459:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574233.252489:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3885 expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.252518:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574233.252525:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574233.252569:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.252588:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.252600:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574233.252950:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030f2342d reply state 0000000010cc1bb3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574233.252965:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574233.255322:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:10440:x1875455727675392:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 2956us (3429us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788574233.255334:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:3.0:1788574233.261810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:1.0:1788574233.262086:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.262101:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.262108:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.262114:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574233.262120:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.262129:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.262150:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:1.0:1788574233.262153:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574233.262158:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.262192:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b535e9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.267594:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727675520 00000100:00100000:0.0:1788574233.267608:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727675520 00000100:00100000:0.0:1788574233.267759:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788574233.267770:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727675520:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788574233.268280:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788574233.268284:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788574233 -> 1788574231 00002000:00010000:0.0:1788574233.268287:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788574229 00002000:00010000:0.0:1788574233.268289:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788574233 -> 1788574231 00002000:00010000:0.0:1788574233.268291:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788574233.268390:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727675520:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 597us (6572us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788574233.268398:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:3.0:1788574233.275308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.275362:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727675776 00000100:00100000:3.0:1788574233.275408:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727675776 00000100:00100000:3.0:1788574233.275495:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:3.0:1788574233.275507:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10440:x1875455727675776:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788574233.275587:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.275617:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 13 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.275627:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.275666:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 13 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.275681:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 13 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574233.275699:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747622528:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574233.275804:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574233.279250:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747622528:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574233.279250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788574233.279276:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.279482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727675904 00000100:00100000:2.0:1788574233.279492:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727675904 00010000:00010000:2.0:1788574233.279535:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 14 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.279577:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:2.0:1788574233.279589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2356:x1875455727675904:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574233.279607:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574233.279614:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 14 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.279628:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 14 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.279689:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b535e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3877 expref: 14 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.279707:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:2.0:1788574233.279712:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.279723:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.279731:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.279759:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574233.279781:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279788:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.279813:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:2356:x1875455727675904:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 226us (568us total) trans 0 rc 0/0 00010000:00010000:3.0:1788574233.279821:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279829:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279844:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279850:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574233.279855:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279863:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279873:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574233.279876:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788574233.279880:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.279887:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ea5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574233.279929:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10440:x1875455727675776:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 4424us (4635us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788574233.279950:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:2.0:1788574233.280185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:3.0:1788574233.282857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574233.285323:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727676032 00000100:00100000:0.0:1788574233.285664:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727676032 00000100:00100000:0.0:1788574233.286032:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788574233.286044:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727676032:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788574233.286202:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.286233:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.286242:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574233.286247:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574233.286252:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.286290:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.286318:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 7 pid: 10306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.286332:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1875455747622656:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574233.286464:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574233.294321:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574233.294474:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1875455747622656:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574233.294505:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.294545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727676160 00000100:00100000:2.0:1788574233.294553:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727676160 00010000:00010000:2.0:1788574233.294588:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 8 pid: 10306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.294627:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:2.0:1788574233.294636:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727676160:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574233.294650:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574233.294674:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 8 pid: 10306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.294706:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 8 pid: 10306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.294730:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f63b8f89/0x10531a153b535e90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3893 expref: 8 pid: 10306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.294746:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574233.294750:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574233.294756:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.294764:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.294792:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574233.294850:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727676160:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 215us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574233.294858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00010000:00010000:0.0:1788574233.296385:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296401:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296433:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296607:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296617:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296648:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574233.296653:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296662:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296680:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.296689:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b535eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.297097:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727676032:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 11045us (14242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574233.297108:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:1.0:1788574233.301075:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574233.301248:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727676416 00000100:00100000:0.0:1788574233.301262:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727676416 00000100:00100000:0.0:1788574233.301332:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:0.0:1788574233.301346:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:10440:x1875455727676416:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788574233.301504:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301526:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301563:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301865:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301878:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301886:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301917:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.301931:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 13 pid: 5859 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.301956:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747622784:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574233.302044:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574233.305004:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747622784:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574233.305037:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574233.305964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574233.306154:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727676544 00000100:00100000:2.0:1788574233.306163:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727676544 00010000:00010000:2.0:1788574233.306207:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 14 pid: 5859 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.306251:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:2.0:1788574233.306261:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2355:x1875455727676544:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574233.306288:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574233.306296:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 14 pid: 5859 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.306308:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 14 pid: 5859 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.306342:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce387e expref: 14 pid: 5859 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.306363:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:2.0:1788574233.306419:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.306429:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.306437:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.306471:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574233.306530:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:2355:x1875455727676544:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 271us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574233.306538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00010000:00010000:1.0:1788574233.306969:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.306980:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574233.307171:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788574233.307454:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788574233.307506:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788574233.307602:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747622912:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788574233.307667:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574233.307698:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574233.308190:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747622912 00000100:00100000:2.0:1788574233.308202:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747622912 00000100:00100000:2.0:1788574233.308272:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574233.308282:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1875455747622912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788574233.308411:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1875455747622912:12345-0@lo:1000:mdt00_001.0 Request processed in 129us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574233.308437:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574233.309102:0:5858:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788574233.309108:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a791d05c00, transno 4294967303 00000100:00100000:0.0:1788574233.309128:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747622912:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788574233.309672:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788574233.309764:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747623040:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574233.309826:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574233.309856:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574233.310605:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747623040 00000100:00100000:2.0:1788574233.310615:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747623040 00000100:00100000:2.0:1788574233.310655:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574233.310664:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1875455747623040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788574233.310879:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747623040:12345-0@lo:1000:mdt00_001.0 Request processed in 215us (1052us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788574233.310888:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574233.311129:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747623040:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788574233.311166:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311176:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311184:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311190:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574233.311195:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311203:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311235:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37900) 00010000:00010000:0.0:1788574233.311239:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574233.311244:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311251:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535eba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311288:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311304:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311311:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311316:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574233.311319:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311325:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311550:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574233.311553:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574233.311556:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311563:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a200/0x10531a153b535de8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311590:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311607:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 16 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311616:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311651:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 16 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.311672:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 16 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.311685:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79233b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747623168:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574233.311928:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574233.316693:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574233.316770:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727676672 00000100:00100000:2.0:1788574233.316780:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727676672 00010000:00010000:2.0:1788574233.316817:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 17 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574233.316867:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:2.0:1788574233.316878:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:2356:x1875455727676672:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574233.316892:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574233.316899:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 17 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.316912:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 17 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.316946:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:2.0:1788574233.316953:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.316963:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.316987:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574233.317007:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574233.317229:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:2356:x1875455727676672:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 351us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574233.317238:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00010000:00010000:0.0:1788574233.317729:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b535e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3862 expref: 16 pid: 10109 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.317810:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79233b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747623168:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574233.317834:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317843:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317849:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317861:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317869:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317875:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317881:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574233.317895:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317903:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317913:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574233.317916:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574233.317920:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.317925:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535ec1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318004:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318011:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318017:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318023:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574233.318026:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318031:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318040:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37300) 00010000:00010000:0.0:1788574233.318042:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574233.318052:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.318059:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535eb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574233.318591:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:10440:x1875455727676416:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 17247us (17528us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788574233.318601:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00000020:00080000:0.0:1788574233.318606:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788574233.319566:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574233.319574:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574233.319602:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788574233.319608:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574233.322891:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574233.323143:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727676928 00000100:00100000:3.0:1788574233.323153:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727676928 00000100:00100000:3.0:1788574233.323226:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788574233.323257:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:10440:x1875455727676928:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788574233.324634:0:5861:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788574233.324902:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788574233.325039:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.325057:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.325071:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.325143:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.325149:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.325155:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574233.325228:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788574233.325363:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:10440:x1875455727676928:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 2103us (2477us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788574233.325408:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000020:00080000:3.0:1788574233.325416:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788574233.328230:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574233.328249:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.328261:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574233.328265:0:6727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.328277:0:6727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.328297:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:0.0:1788574233.328299:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788574233.328304:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574233.328310:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b535ec8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574233.328677:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574233.328680:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574233.328682:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574233.729263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a70ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747623552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574233.729337:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574233.729450:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574233.729458:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a70ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747623680:0@lo:400:kworker.0 00000100:00100000:0.0:1788574233.729484:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574233.729565:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a70edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747623296:0@lo:400:kworker.0 00000100:00100000:1.0:1788574233.729601:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574233.729632:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574233.729638:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a70ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788574233.729658:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747623552 00000100:00100000:3.0:1788574233.729666:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747623552 00000100:00100000:1.0:1788574233.729670:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574233.729715:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747623680 00000100:00100000:3.0:1788574233.729719:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747623680 00000100:00100000:3.0:1788574233.729750:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747623424 00000100:00100000:3.0:1788574233.729760:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747623424 00000100:00100000:3.0:1788574233.729779:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788574233.729788:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747623552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574233.729801:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788574233.729808:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747623680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574233.729846:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747623680:12345-0@lo:400:kworker.0 Request processed in 38us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574233.729854:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788574233.729877:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788574233.729884:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747623424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574233.729914:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747623424:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574233.729920:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788574233.729977:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a70ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747623424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574233.730474:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747623296 00000100:00100000:0.0:1788574233.730480:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747623296 00000100:00100000:3.0:1788574233.730509:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747623552:12345-0@lo:400:kworker.0 Request processed in 720us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574233.730516:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788574233.730518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788574233.730525:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747623296:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788574233.730541:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574233.730563:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747623296:12345-0@lo:400:kworker.0 Request processed in 39us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574233.730570:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788574233.730607:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a70edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747623296:0@lo:400:kworker.0 00000100:00100000:1.0:1788574233.730913:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a70ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747623680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574233.730929:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a70ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747623552:0@lo:400:kworker.0 00010000:00010000:0.0:1788574233.920520:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574234.249558:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574234.249579:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747623808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574234.249657:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574234.254205:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747623808 00000100:00100000:3.0:1788574234.254217:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747623808 00000100:00100000:3.0:1788574234.254264:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574234.254275:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747623808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574234.254309:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574234.254412:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747623808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574234.254419:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574234.273605:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747623808:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788574234.348092:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1788574234.348117:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1788574234.948229:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574235.214244:0:12076:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574235.214257:0:12076:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574235.214296:0:12076:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788574235.214302:0:12076:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574235.473817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574235.474052:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727677184 00000100:00100000:2.0:1788574235.474065:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727677184 00000100:00100000:2.0:1788574235.474156:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:2.0:1788574235.474184:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:10459:x1875455727677184:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574235.474213:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574235.474234:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce389a expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.474344:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ed6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.474360:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.474397:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574235.474411:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788574235.474827:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce389a expref: 20 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.474849:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce389a expref: 19 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.474876:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:2.0:1788574235.474880:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574235.474884:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984e00, rc 0) 00000100:00100000:2.0:1788574235.475096:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:10459:x1875455727677184:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 929us (1294us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788574235.475103:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00080000:3.0:1788574235.475454:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574235.487605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574235.487873:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727677312 00000100:00100000:1.0:1788574235.487886:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727677312 00000100:00100000:1.0:1788574235.487955:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:1.0:1788574235.487966:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:10459:x1875455727677312:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:1.0:1788574235.488092:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488123:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488137:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488155:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488341:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488354:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488865:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488876:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488883:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574235.488928:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488943:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488949:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488968:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488975:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574235.488980:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.488989:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.489005:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:1.0:1788574235.491273:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574235.491286:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491297:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b535ee4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491318:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491325:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491332:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491339:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574235.491343:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491662:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491683:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a7b2398500) 00010000:00010000:1.0:1788574235.491686:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574235.491690:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491697:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b535eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491716:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491723:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491728:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491733:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574235.491736:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491742:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491749:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a7b2398800) 00010000:00010000:1.0:1788574235.491752:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574235.491755:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.491771:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574235.492155:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:10459:x1875455727677312:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 4183us (4561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574235.492635:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:3.0:1788574235.569882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574235.577864:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727677568 00000100:00100000:0.0:1788574235.577880:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727677568 00000100:00100000:0.0:1788574235.577955:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:0.0:1788574235.577967:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:10462:x1875455727677568:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574235.577990:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574235.578026:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b535ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.578113:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.578131:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.578144:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.578334:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.578342:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.578349:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.579353:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580090:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580110:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574235.580124:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788574235.580326:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580335:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580342:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580348:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574235.580353:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580828:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580844:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574235.580847:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574235.580853:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580860:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b535f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580875:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580882:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580888:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580893:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574235.580896:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580902:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580910:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a78544f600) 00010000:00010000:0.0:1788574235.580912:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574235.580915:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580933:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.580989:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b535ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 22 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.581004:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.581026:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574235.581028:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574235.581031:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574235.581109:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10462:x1875455727677568:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 3143us (11235us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788574235.581117:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:0.0:1788574235.593038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574235.593117:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727677696 00000100:00100000:1.0:1788574235.593128:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727677696 00000100:00100000:1.0:1788574235.593205:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:1.0:1788574235.593219:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10462:x1875455727677696:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788574235.593287:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593307:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593320:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593349:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593357:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593364:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593415:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574235.593420:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593429:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593460:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574235.593464:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574235.593470:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.593478:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b535f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574235.595447:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10462:x1875455727677696:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 2216us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574235.595466:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:3.0:1788574235.598121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574235.598198:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727677952 00000100:00100000:0.0:1788574235.598208:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727677952 00000100:00100000:0.0:1788574235.598263:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574235.598274:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785620c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10462:x1875455727677952:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788574235.598507:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785620c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:10462:x1875455727677952:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 234us (392us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788574235.598516:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788574235.707885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574235.707970:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727678208 00000100:00100000:3.0:1788574235.707982:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727678208 00000100:00100000:3.0:1788574235.708086:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:3.0:1788574235.708097:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:9983:x1875455727678208:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574235.708123:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574235.708145:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535f23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38a8 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.708261:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.708277:0:10109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.708286:0:10109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.708326:0:10109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.708341:0:10109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 23 pid: 5858 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574235.708362:0:10109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747623936:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574235.708482:0:10109:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574235.712198:0:10109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747623936:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574235.712235:0:10109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574235.713063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574235.713187:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727678336 00000100:00100000:3.0:1788574235.713198:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727678336 00010000:00010000:3.0:1788574235.713245:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 24 pid: 5858 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574235.713306:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:3.0:1788574235.713316:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:2356:x1875455727678336:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574235.713419:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574235.713431:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 24 pid: 5858 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.713444:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 24 pid: 5858 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.713468:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b535f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a1 expref: 24 pid: 5858 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.713487:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574235.713493:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.713503:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.713511:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.713535:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574235.713664:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:2356:x1875455727678336:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 348us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574235.713673:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00010000:00010000:0.0:1788574235.714904:0:10109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.714924:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574235.714948:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788574235.715135:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535f23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 24 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.715155:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 23 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.715251:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574235.715255:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574235.715259:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6600, rc 0) 00000100:00100000:0.0:1788574235.715319:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:9983:x1875455727678208:12345-192.168.201.57@tcp:101:bash.0 Request processed in 7224us (7447us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788574235.715327:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:3.0:1788574235.727902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574235.728712:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727678592 00000100:00100000:0.0:1788574235.728724:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727678592 00000100:00100000:0.0:1788574235.728791:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:0.0:1788574235.728802:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:9983:x1875455727678592:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:0.0:1788574235.729054:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.729074:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.729098:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574235.729158:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788574235.729193:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f3d1c83 reply state 0000000049c0eda8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574235.729203:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788574235.729255:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788574235.730243:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:9983:x1875455727678592:12345-192.168.201.57@tcp:36:bash.0 Request processed in 1432us (2343us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788574235.730255:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000020:00080000:0.0:1788574235.730263:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788574235.738146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574235.738323:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727678720 00000100:00100000:2.0:1788574235.738334:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727678720 00000100:00100000:2.0:1788574235.738435:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:2.0:1788574235.738449:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:9983:x1875455727678720:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574235.738481:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574235.738508:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535f3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38af expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.738604:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38af expref: 28 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.738636:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38af expref: 28 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.738660:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574235.738663:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574235.738667:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985c00, rc 0) 00000100:00100000:2.0:1788574235.738745:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:9983:x1875455727678720:12345-192.168.201.57@tcp:101:bash.0 Request processed in 298us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574235.738772:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00010000:00010000:0.0:1788574235.744203:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.744224:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.744232:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.744238:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574235.744244:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.744254:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.744277:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574235.744302:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574235.744308:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.744314:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574235.747925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574235.748124:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727678848 00000100:00100000:2.0:1788574235.748136:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727678848 00000100:00100000:2.0:1788574235.748260:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:2.0:1788574235.748271:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79106f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:9983:x1875455727678848:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574235.748292:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574235.748318:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38b6 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574235.748353:0:10306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b7a17, atime: 0x6a9b7a15, ctime: 0x6a9b7a17, blocks: 0xb 00010000:00010000:2.0:1788574235.748414:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788574235.748420:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574235.748431:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.748456:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.748472:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574235.748570:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79106f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:9983:x1875455727678848:12345-192.168.201.57@tcp:101:bash.0 Request processed in 300us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574235.748577:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00080000:3.0:1788574235.749816:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574235.755517:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574235.755801:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727678976 00000100:00100000:3.0:1788574235.755817:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727678976 00002000:00010000:3.0:1788574235.755881:0:6717:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788574235.755887:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bfb0c000 with x1875455727678976 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574235.755901:0:6717:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bfb0c000. 00000100:00100000:3.0:1788574235.755947:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788574235.755959:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727678976:12345-192.168.201.57@tcp:10:bash.0 00002000:00010000:3.0:1788574235.756325:0:6717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788574235.756329:0:6717:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788574231 -> 1788574236 00002000:00010000:3.0:1788574235.756332:0:6717:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788574229 -> 1788574229 00002000:00010000:3.0:1788574235.756334:0:6717:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788574231 -> 1788574236 00002000:00010000:3.0:1788574235.756337:0:6717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788574235.756436:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2354:x1875455727678976:12345-192.168.201.57@tcp:10:bash.0 Request processed in 478us (930us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788574235.756444:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00002000:00010000:3.0:1788574235.756447:0:6717:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788574235.756450:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bfb0c000 with x1875455727678976 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574235.756455:0:6717:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bfb0c000. 00000100:00100000:1.0:1788574235.870426:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574235.870598:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727679104 00000100:00100000:0.0:1788574235.870611:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727679104 00000100:00100000:0.0:1788574235.870678:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:0.0:1788574235.870689:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:10476:x1875455727679104:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:0.0:1788574235.870779:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.870798:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.870812:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.870828:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.870835:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.870841:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871113:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871134:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871142:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574235.871230:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871242:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871248:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871255:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871261:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574235.871265:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871272:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871284:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574235.871286:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574235.871291:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871297:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b535f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871318:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871324:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871330:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871335:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574235.871338:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871344:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871352:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a78544f600) 00010000:00010000:0.0:1788574235.871354:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574235.871357:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871362:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b535f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871429:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871436:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871441:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871452:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574235.871456:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871462:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871470:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574235.871472:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574235.871475:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.871480:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b535f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574235.871591:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:10476:x1875455727679104:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 900us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574235.871601:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:0.0:1788574235.938861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574235.938924:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727679360 00000100:00100000:3.0:1788574235.938938:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727679360 00000100:00100000:3.0:1788574235.939261:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:3.0:1788574235.939273:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:10479:x1875455727679360:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574235.939293:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574235.939314:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38bd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939454:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939469:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939480:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939496:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939502:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939507:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939895:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535f77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939906:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.939914:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574235.939924:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788574235.940031:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940046:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940060:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940067:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574235.940073:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940082:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940096:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574235.940099:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574235.940104:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940110:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940124:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940130:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940137:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940142:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574235.940145:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940179:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940188:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37b00) 00010000:00010000:3.0:1788574235.940190:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574235.940194:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940200:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940247:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38bd expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940262:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38bd expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.940270:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574235.940272:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788574235.940275:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7e00, rc 0) 00000100:00100000:3.0:1788574235.940355:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:10479:x1875455727679360:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1084us (1504us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788574235.940363:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:2.0:1788574235.946579:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574235.946738:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727679488 00000100:00100000:3.0:1788574235.946747:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727679488 00000100:00100000:3.0:1788574235.946813:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:3.0:1788574235.946824:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:10479:x1875455727679488:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788574235.946910:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.946929:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 29 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.946941:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.946979:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 29 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.946995:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 29 pid: 10109 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574235.947009:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747624064:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574235.947136:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574235.951447:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747624064:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574235.951480:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574235.951988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574235.952073:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727679744 00000100:00100000:3.0:1788574235.952080:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727679744 00000100:00100000:3.0:1788574235.952155:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788574235.952261:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+30:5593:x1875455727679744:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788574235.952608:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:5593:x1875455727679744:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 441us (620us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788574235.952632:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788574235.958283:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574235.958440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727679872 00000100:00100000:2.0:1788574235.958466:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727679872 00010000:00010000:2.0:1788574235.958510:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 31 pid: 10109 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574235.958573:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:2.0:1788574235.958584:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:2355:x1875455727679872:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574235.958600:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574235.958607:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 31 pid: 10109 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.958621:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 31 pid: 10109 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.958642:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535f2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38a8 expref: 31 pid: 10109 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.958659:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574235.958664:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.958674:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.958683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.959035:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574235.959113:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+30:2355:x1875455727679872:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 529us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574235.959131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00010000:00010000:3.0:1788574235.960006:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960018:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960057:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960066:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960073:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960078:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574235.960083:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960090:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960102:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574235.960105:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574235.960109:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.960116:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574235.960297:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:10479:x1875455727679488:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 13471us (13727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574235.960316:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:1.0:1788574235.965866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574235.966044:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727680128 00000100:00100000:2.0:1788574235.966054:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727680128 00000100:00100000:2.0:1788574235.966184:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:2.0:1788574235.966195:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:10479:x1875455727680128:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574235.966654:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+30:10479:x1875455727680128:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 458us (794us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788574235.966674:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00010000:00010000:1.0:1788574235.971757:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574236.093800:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.093966:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727680384 00000100:00100000:3.0:1788574236.093979:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727680384 00000100:00100000:3.0:1788574236.094047:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:3.0:1788574236.094059:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+30:10490:x1875455727680384:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788574236.094087:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.094123:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38c4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.094223:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.094238:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.094250:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.094265:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.094272:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.094278:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095044:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095069:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095078:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.095603:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788574236.095880:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095889:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095896:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095902:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.095907:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095914:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095929:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574236.095932:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.095936:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095941:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095956:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095973:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095978:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095983:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.095986:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.095993:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.096000:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37b00) 00010000:00010000:3.0:1788574236.096003:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.096006:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.096011:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.096068:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535f8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38c4 expref: 33 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.096084:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38c4 expref: 32 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.096302:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574236.096304:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574236.096313:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6600, rc 0) 00000100:00100000:3.0:1788574236.096630:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:10490:x1875455727680384:12345-192.168.201.57@tcp:101:cat.0 Request processed in 2572us (2841us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788574236.096639:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:0.0:1788574236.106554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.106627:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727680640 00000100:00100000:3.0:1788574236.106637:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727680640 00000100:00100000:3.0:1788574236.106703:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788574236.106718:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:10490:x1875455727680640:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:3.0:1788574236.106955:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+33:10490:x1875455727680640:12345-192.168.201.57@tcp:35:cat.0 Request processed in 242us (407us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788574236.106963:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:1.0:1788574236.124099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.124251:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727680896 00000100:00100000:3.0:1788574236.124262:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727680896 00000100:00100000:3.0:1788574236.124323:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:3.0:1788574236.124343:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+33:10491:x1875455727680896:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:3.0:1788574236.124438:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788574236.124466:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38c4 expref: 33 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124493:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535f77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38bd expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124504:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b535f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38af expref: 31 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124514:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574236.124525:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574236.124560:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124574:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124583:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124598:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124605:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124612:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124952:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124961:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.124968:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574236.126081:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788574236.126095:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362300726306ns, next at 363300722994ns, rc = 0 00010000:00010000:3.0:1788574236.126185:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126200:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126219:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126228:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126234:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126240:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126270:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574236.126295:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126303:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126309:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126315:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.126319:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126326:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126348:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37600) 00010000:00010000:3.0:1788574236.126351:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788574236.126362:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126403:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126422:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126429:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126435:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126440:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.126443:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126449:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126457:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574236.126459:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.126462:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.126468:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535faf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574236.126477:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6082372 reply state 000000004f8d2af7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.126497:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574236.126582:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:10491:x1875455727680896:12345-192.168.201.57@tcp:36:rm.0 Request processed in 2245us (2489us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788574236.126591:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 95 00010000:00010000:1.0:1788574236.127011:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574236.127018:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.127025:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574236.127028:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.127035:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.127052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90a784e37600) 00010000:00010000:1.0:1788574236.127054:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788574236.127058:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.127064:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b535fc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.127080:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574236.127082:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574236.127083:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574236.134860:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.134880:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.134887:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.134893:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574236.134898:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.134905:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.134933:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37b00) 00010000:00010000:1.0:1788574236.134937:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574236.134943:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.134971:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b535fb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.182007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.182686:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727681152 00000100:00100000:3.0:1788574236.182705:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727681152 00000100:00100000:3.0:1788574236.182788:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:3.0:1788574236.182801:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:10497:x1875455727681152:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574236.182834:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.182863:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535fcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38cb expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.183065:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.183082:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.183095:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.183111:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.183118:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.183125:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574236.185630:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788574236.186293:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186318:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186577:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186626:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186633:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186640:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186646:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.186651:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186659:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186672:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574236.186675:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.186680:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186832:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b535fd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574236.186850:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3203160 reply state 00000000c3841f75 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.186859:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788574236.186898:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b535fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186913:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.186921:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:3.0:1788574236.186923:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574236.186926:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6600, rc 0) 00000100:00100000:3.0:1788574236.187141:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10497:x1875455727681152:12345-192.168.201.57@tcp:101:bash.0 Request processed in 4333us (5136us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788574236.187150:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:0.0:1788574236.193612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788574236.194477:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.194497:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.194505:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.194511:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.194536:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.194545:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.194566:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37500) 00010000:00010000:3.0:1788574236.194570:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.194576:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.194584:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535fd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.194885:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727681280 00000100:00100000:1.0:1788574236.194895:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727681280 00000100:00100000:1.0:1788574236.195011:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:1.0:1788574236.195025:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727681280:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788574236.195053:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574236.195075:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38d2 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574236.195102:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574236.195120:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1788574236.195125:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574236.195145:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 6 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.195174:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 6 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.195187:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574236.195252:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727681280:12345-192.168.201.57@tcp:101:bash.0 Request processed in 232us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.195259:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00080000:3.0:1788574236.199298:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574236.199657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574236.199808:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727681408 00000100:00100000:2.0:1788574236.199818:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727681408 00000100:00100000:2.0:1788574236.199878:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:2.0:1788574236.199889:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:10497:x1875455727681408:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574236.199910:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574236.199933:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38d9 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.199967:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.199977:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574236.199981:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574236.199988:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.200057:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.200081:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574236.200095:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a70ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6712:1875455747624192:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574236.200213:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574236.204943:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.205074:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a70ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6712:1875455747624192:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574236.205110:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.205146:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984a00, rc 0) 00000100:00100000:3.0:1788574236.205220:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:10497:x1875455727681408:12345-192.168.201.57@tcp:101:bash.0 Request processed in 5332us (5580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.205229:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:1.0:1788574236.205744:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727681536 00000100:00100000:1.0:1788574236.205756:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727681536 00010000:00010000:1.0:1788574236.205800:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.205842:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788574236.205852:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79260a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727681536:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574236.205871:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574236.205902:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.205918:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.205945:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b535fee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d2 expref: 7 pid: 6713 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.205964:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574236.205969:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574236.205979:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 6 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.205991:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 6 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.206042:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 6 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.206076:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1875455747624320:192.168.201.57@tcp:105: 00000100:00100000:1.0:1788574236.206702:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a87780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574236.213555:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1875455747624320:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788574236.213584:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574236.213654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79260a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727681536:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 7802us (8726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.213666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788574236.217753:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.217957:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727681792 00000100:00100000:3.0:1788574236.217967:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727681792 00000100:00100000:3.0:1788574236.218020:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788574236.218032:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+33:10497:x1875455727681792:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788574236.218920:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10497:x1875455727681792:12345-192.168.201.57@tcp:35:bash.0 Request processed in 884us (1178us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788574236.218951:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:2.0:1788574236.479980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.480107:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727681920 00000100:00100000:3.0:1788574236.480118:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727681920 00000100:00100000:3.0:1788574236.480197:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:3.0:1788574236.480209:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:10513:x1875455727681920:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574236.480237:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.480260:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38e0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.480337:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b536003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.480356:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b536003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.480427:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b536003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.480472:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788574236.480476:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574236.480499:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b536003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.480530:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b535ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38e0 expref: 36 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.480553:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b536003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38e0 expref: 35 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.480593:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574236.480598:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574236.480604:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7600, rc 0) 00000100:00100000:3.0:1788574236.480692:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:10513:x1875455727681920:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 485us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.480699:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:1.0:1788574236.486044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.486354:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727682176 00000100:00100000:3.0:1788574236.486395:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727682176 00000100:00100000:3.0:1788574236.486464:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:3.0:1788574236.486474:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:10513:x1875455727682176:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574236.486499:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.486525:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53600a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.486632:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.486646:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.486657:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.486669:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788574236.487087:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53600a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38e7 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.487329:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38e7 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.487340:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:3.0:1788574236.487343:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574236.487347:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574236.487500:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:10513:x1875455727682176:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1026us (1467us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788574236.487509:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:2.0:1788574236.507905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574236.508021:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.508124:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727682432 00000100:00100000:3.0:1788574236.508140:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727682432 00000100:00100000:3.0:1788574236.508226:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:3.0:1788574236.508238:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:10513:x1875455727682432:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574236.508265:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.508289:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53601f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38ee expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.508460:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536026 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.508478:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.508490:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.508504:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788574236.508665:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53601f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38ee expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.508699:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38ee expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.508709:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:3.0:1788574236.508722:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788574236.508726:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7e00, rc 0) 00000100:00100000:3.0:1788574236.508808:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:10513:x1875455727682432:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 572us (786us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788574236.508817:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:1.0:1788574236.509943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727682560 00000100:00100000:1.0:1788574236.509954:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727682560 00000100:00100000:1.0:1788574236.510012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788574236.510023:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:2356:x1875455727682560:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574236.510035:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574236.510051:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38e7 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.510066:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:1.0:1788574236.510070:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574236.510263:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:2356:x1875455727682560:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 241us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.510271:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574236.516040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574236.516220:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727682688 00000100:00100000:1.0:1788574236.516232:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727682688 00000100:00100000:1.0:1788574236.516330:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:1.0:1788574236.516349:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727682688:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:1.0:1788574236.516410:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.516425:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 6 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.516431:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574236.516434:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574236.516438:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.516466:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 6 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.516477:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 6 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.516488:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6713:1875455747624448:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574236.516561:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574236.518822:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.518963:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727682816 00000100:00100000:3.0:1788574236.518975:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727682816 00002000:00100000:3.0:1788574236.519050:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90a7a70ec000 x1875455727682816/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:387/0 lens 504/0 e 0 to 0 dl 1788574247 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574236.519063:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a70ec000 with x1875455727682816 ext(0->8) 00010000:00010000:3.0:1788574236.519072:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 7 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.519100:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 7 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574236.519107:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a7a70ec000 00000100:00100000:3.0:1788574236.519195:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788574236.519206:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727682816:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:1.0:1788574236.519288:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6713:1875455747624448:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574236.519313:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.520046:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727682816:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 837us (1228us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788574236.520062:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00002000:00100000:3.0:1788574236.520072:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90a7a70ec000 x1875455727682816/t4294967302(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:387/0 lens 504/448 e 0 to 0 dl 1788574247 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574236.520091:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a70ec000 with x1875455727682816 ext(0->8) 00010000:00010000:3.0:1788574236.520098:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 9 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.520110:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 9 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574236.520118:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a7a70ec000 00000100:00100000:2.0:1788574236.522144:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574236.522211:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727682944 00000100:00100000:1.0:1788574236.522220:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727682944 00010000:00010000:1.0:1788574236.522275:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 9 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.522311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:1.0:1788574236.522322:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727682944:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574236.522470:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788574236.522491:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788574236.522494:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788574236 00002000:00010000:1.0:1788574236.522495:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788574236 00002000:00010000:1.0:1788574236.522497:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788574236 00010000:00010000:1.0:1788574236.522501:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 9 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.522512:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 9 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.522531:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b535ff5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38d9 expref: 9 pid: 6712 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.522546:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574236.522549:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574236.522554:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.522562:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.522598:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574236.522627:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522637:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.522652:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727682944:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 333us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.522659:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00010000:00010000:3.0:1788574236.522664:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522673:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522681:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522700:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574236.522704:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522713:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522726:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.522734:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536034 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.522785:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727682688:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 6437us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.522791:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:2.0:1788574236.524568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.524643:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727683200 00000100:00100000:3.0:1788574236.524653:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727683200 00000100:00100000:3.0:1788574236.524823:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:3.0:1788574236.524834:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785621850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:10513:x1875455727683200:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:3.0:1788574236.524904:0:5861:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38ee expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574236.525252:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788574236.525295:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788574236.525966:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788574236.526026:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.526046:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.526055:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.526167:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.526184:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 42 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.526198:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5861:1875455747624576:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574236.526281:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574236.528920:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5861:1875455747624576:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574236.528953:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574236.529147:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574236.529410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727683328 00000100:00100000:1.0:1788574236.529420:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727683328 00010000:00010000:1.0:1788574236.529472:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 43 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.529547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574236.529555:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:2355:x1875455727683328:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574236.529568:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574236.529573:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 43 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.529583:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 43 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.529603:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b535fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38cb expref: 43 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.529616:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:1.0:1788574236.529619:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.529628:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.529647:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.529671:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574236.529743:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:2355:x1875455727683328:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 188us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.529749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00010000:00010000:3.0:1788574236.529807:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.529815:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574236.529951:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788574236.530153:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788574236.530281:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747624704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788574236.530326:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574236.530351:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574236.530364:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747624704 00000100:00100000:0.0:1788574236.530393:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747624704 00000100:00100000:0.0:1788574236.530449:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574236.530457:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1875455747624704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788574236.530559:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1875455747624704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.530578:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574236.530581:0:5861:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788574236.530586:0:5861:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000100:00080000:0.0:1788574236.530596:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788574236.530607:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a792339f80, transno 4294967301 00000100:00100000:3.0:1788574236.530618:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747624704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788574236.531557:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788574236.531639:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747624832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788574236.531684:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574236.531782:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574236.532000:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747624832 00000100:00100000:2.0:1788574236.532068:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747624832 00000100:00100000:2.0:1788574236.532165:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574236.532175:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5861:x1875455747624832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788574236.532399:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5861:x1875455747624832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 224us (713us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788574236.532407:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574236.532484:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747624832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788574236.532535:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788574236.532571:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.532579:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.532585:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.532590:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.532594:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.532600:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.532625:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:3.0:1788574236.532627:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788574236.532631:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.532635:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b53603b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574236.532856:0:5861:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788574236.532920:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788574236.532929:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362707560150ns, next at 363707558316ns, rc = 0 00000001:00080000:3.0:1788574236.532933:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788574236.532954:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37200) 00010000:00010000:3.0:1788574236.532956:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788574236.532961:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536026 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38ee expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.534674:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785621850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:10513:x1875455727683200:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 9828us (10099us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788574236.534689:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000020:00080000:3.0:1788574236.534699:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788574236.541960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.542200:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727683456 00000100:00100000:3.0:1788574236.542213:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727683456 00000100:00100000:3.0:1788574236.542277:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:3.0:1788574236.542289:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:10513:x1875455727683456:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574236.542312:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.542334:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38f5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.543600:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536042 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38f5 expref: 46 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.543642:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536042 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38f5 expref: 46 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.543671:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574236.543675:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574236.543680:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6000, rc 0) 00000100:00100000:2.0:1788574236.543974:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:10513:x1875455727683456:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1684us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574236.543984:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:2.0:1788574236.550354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574236.551166:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727683712 00000100:00100000:0.0:1788574236.551180:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727683712 00000100:00100000:0.0:1788574236.551287:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:0.0:1788574236.551299:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:10513:x1875455727683712:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788574236.551669:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:10513:x1875455727683712:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 370us (1323us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788574236.551677:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:1.0:1788574236.659900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.660011:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727683840 00000100:00100000:3.0:1788574236.660024:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727683840 00000100:00100000:3.0:1788574236.660105:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:3.0:1788574236.660118:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:10523:x1875455727683840:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788574236.660227:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660246:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660262:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660279:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660285:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660291:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660467:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660476:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660483:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574236.660559:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660575:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660584:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660591:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660597:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.660601:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660609:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660622:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574236.660625:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.660631:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660638:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660655:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660661:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660674:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660679:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.660756:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660766:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660774:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37200) 00010000:00010000:3.0:1788574236.660777:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.660780:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660786:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b536050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660804:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660810:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660815:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660821:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574236.660823:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660840:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660848:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574236.660851:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.660855:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.660860:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.660947:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:10523:x1875455727683840:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 830us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.660955:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:2.0:1788574236.748777:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574236.748892:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727684096 00000100:00100000:0.0:1788574236.748905:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727684096 00000100:00100000:0.0:1788574236.748990:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788574236.749001:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:10526:x1875455727684096:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574236.749039:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574236.749065:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53605e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce38fc expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749173:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749192:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749206:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749221:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749246:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749254:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749455:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b536073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749464:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b536073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749472:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b536073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574236.749483:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788574236.749611:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749619:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749625:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749631:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574236.749636:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749644:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749666:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574236.749669:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574236.749674:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749680:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749880:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749887:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749893:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749900:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574236.749903:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749909:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749916:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a78544f600) 00010000:00010000:0.0:1788574236.749919:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574236.749922:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749928:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53606c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749984:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53605e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38fc expref: 50 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.749998:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b536073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38fc expref: 49 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.750006:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574236.750008:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574236.750010:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d000, rc 0) 00000100:00100000:0.0:1788574236.750080:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10526:x1875455727684096:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1081us (1324us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788574236.750088:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:1.0:1788574236.755636:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574236.755726:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727684224 00000100:00100000:2.0:1788574236.755735:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727684224 00000100:00100000:2.0:1788574236.756283:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:2.0:1788574236.756294:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10526:x1875455727684224:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:2.0:1788574236.756409:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756426:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756439:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756464:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756471:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756492:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756498:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574236.756503:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756510:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756522:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574236.756525:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574236.756529:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.756537:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574236.756611:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10526:x1875455727684224:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 318us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574236.756618:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:1.0:1788574236.761002:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.761122:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727684480 00000100:00100000:3.0:1788574236.761134:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727684480 00000100:00100000:3.0:1788574236.761226:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788574236.761237:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:10526:x1875455727684480:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574236.761541:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:10526:x1875455727684480:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 305us (551us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788574236.761550:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:0.0:1788574236.803606:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574236.803631:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747624960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574236.803708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574236.803953:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747624960 00000100:00100000:3.0:1788574236.803962:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747624960 00000100:00100000:3.0:1788574236.804031:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574236.804040:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747624960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574236.804072:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574236.804118:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747624960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.804137:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574236.804199:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747624960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574236.804316:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574236.896036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574236.896108:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727684736 00000100:00100000:2.0:1788574236.896121:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727684736 00000100:00100000:2.0:1788574236.896215:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:2.0:1788574236.896228:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:10536:x1875455727684736:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574236.896261:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574236.896264:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788574236.896295:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b536003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38e0 expref: 50 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.896357:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:2.0:1788574236.896363:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574236.896434:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3903 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.896541:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53608f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.896556:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53608f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.896565:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53608f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574236.896577:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788574236.896701:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3903 expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.896714:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53608f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3903 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.896721:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574236.896724:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574236.896727:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574236.896787:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10536:x1875455727684736:12345-192.168.201.57@tcp:101:bash.0 Request processed in 562us (768us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788574236.896794:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:1.0:1788574236.906588:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.910161:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727684992 00000100:00100000:3.0:1788574236.910184:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727684992 00000100:00100000:3.0:1788574236.910339:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 105 00000100:00100000:3.0:1788574236.910353:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:10536:x1875455727684992:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:3.0:1788574236.910441:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788574236.910475:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53608f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3903 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.910506:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b536073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38fc expref: 50 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.910521:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574236.910527:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574236.910771:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.910786:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.910797:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574236.910850:0:10109:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788574236.910876:0:10109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007544ae5c reply state 00000000942a8b17 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.910909:0:10109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574236.911041:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10536:x1875455727684992:12345-192.168.201.57@tcp:36:bash.0 Request processed in 690us (4466us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788574236.911049:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 105 00000020:00080000:3.0:1788574236.911056:0:10109:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788574236.920404:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.920450:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727685120 00000100:00100000:3.0:1788574236.920464:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727685120 00000100:00100000:3.0:1788574236.920535:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 106 00000100:00100000:3.0:1788574236.920548:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10536:x1875455727685120:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574236.920625:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.920656:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce390a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.920709:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.920718:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.920725:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.920731:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574236.920736:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.920744:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.920751:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.922517:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.922549:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.922611:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788574236.922617:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574236.922644:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.922688:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.922734:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.922742:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574236.922745:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574236.922749:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7e00, rc 0) 00000100:00100000:3.0:1788574236.922828:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10536:x1875455727685120:12345-192.168.201.57@tcp:101:bash.0 Request processed in 2281us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.922847:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 106 00010000:00010000:1.0:1788574236.929884:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:1.0:1788574236.929898:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574236.929929:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.929941:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b53609d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574236.933645:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574236.936817:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727685376 00000100:00100000:3.0:1788574236.936836:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727685376 00000100:00100000:3.0:1788574236.937666:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:3.0:1788574236.937688:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:10536:x1875455727685376:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788574236.937968:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10536:x1875455727685376:12345-192.168.201.57@tcp:35:bash.0 Request processed in 289us (4334us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788574236.937977:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00010000:00010000:3.0:1788574236.992781:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574237.060604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.060735:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727685504 00000100:00100000:1.0:1788574237.060747:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727685504 00000100:00100000:1.0:1788574237.060837:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 107 00000100:00100000:1.0:1788574237.060849:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:10542:x1875455727685504:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574237.060873:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574237.060897:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b5360b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3911 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788574237.060900:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574237.060970:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b5360b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.060984:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b5360b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.060996:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b5360b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574237.061050:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788574237.061055:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574237.061074:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b5360b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.061102:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b5360b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3911 expref: 55 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.061122:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b5360b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3911 expref: 54 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.061161:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:1.0:1788574237.061164:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574237.061168:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20800, rc 0) 00000100:00100000:1.0:1788574237.061241:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727685504:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 395us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.061250:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 107 00000100:00100000:1.0:1788574237.066070:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.066163:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727685632 00000100:00100000:3.0:1788574237.066173:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727685632 00000100:00100000:3.0:1788574237.066232:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:3.0:1788574237.066243:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727685632:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574237.066265:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.066290:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3918 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066419:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066434:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066445:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066458:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066464:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066471:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066553:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066561:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066568:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574237.066604:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788574237.066608:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574237.066625:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066647:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066655:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066662:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066668:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066674:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574237.066691:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066699:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066711:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574237.066714:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574237.066718:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066725:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5360c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066737:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066743:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066984:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.066992:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574237.067085:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.067094:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.067103:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37200) 00010000:00010000:3.0:1788574237.067106:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574237.067109:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.067115:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b5360ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.067162:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3918 expref: 56 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.067178:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3918 expref: 55 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.067186:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574237.067188:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574237.067191:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6800, rc 0) 00000100:00100000:3.0:1788574237.067422:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10542:x1875455727685632:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1180us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.067440:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:0.0:1788574237.081251:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.081302:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.082816:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727685760 00000100:00100000:1.0:1788574237.082830:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727685760 00000100:00100000:1.0:1788574237.082911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788574237.082922:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:2356:x1875455727685760:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574237.082938:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574237.082962:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5360d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3918 expref: 55 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.082982:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:1.0:1788574237.082987:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574237.083060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:2356:x1875455727685760:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 139us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.083068:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574237.086570:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686016 00000100:00100000:3.0:1788574237.086586:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686016 00000100:00100000:2.0:1788574237.089663:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:2.0:1788574237.089691:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727686016:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574237.089718:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574237.089745:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5360dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce391f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.089866:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.089882:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.089892:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.089926:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.089941:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 55 pid: 5858 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.089954:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a70eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747625088:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574237.090065:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792369600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574237.096266:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.096401:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686144 00000100:00100000:1.0:1788574237.096417:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686144 00010000:00010000:1.0:1788574237.096477:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 56 pid: 5858 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.096532:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:1.0:1788574237.096561:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:2355:x1875455727686144:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574237.096577:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574237.096585:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 56 pid: 5858 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.096600:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 56 pid: 5858 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.096621:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:1.0:1788574237.096627:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.096637:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.096646:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.096667:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574237.096901:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:2355:x1875455727686144:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 342us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.096909:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00010000:00010000:2.0:1788574237.098322:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5360ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce390a expref: 55 pid: 5858 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.098574:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a70eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747625088:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574237.098631:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.098642:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.098649:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574237.098672:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788574237.098963:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5360dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.098981:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.098990:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574237.098994:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574237.098997:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985c00, rc 0) 00000100:00100000:2.0:1788574237.099226:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10542:x1875455727686016:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 9548us (17922us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788574237.099234:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:0.0:1788574237.102937:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.103022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686400 00000100:00100000:2.0:1788574237.103033:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686400 00000100:00100000:2.0:1788574237.103100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574237.103114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10542:x1875455727686400:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:2.0:1788574237.103135:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574237.103177:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38f5 expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.103218:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574237.103225:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574237.103295:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727686400:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.103303:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:0.0:1788574237.106653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.106767:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686528 00000100:00100000:1.0:1788574237.106777:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686528 00000100:00100000:1.0:1788574237.106842:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:1.0:1788574237.106855:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727686528:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:1.0:1788574237.106959:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.106992:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.107005:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574237.107223:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788574237.107313:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727686528:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 459us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.107320:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:0.0:1788574237.110128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.110287:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686656 00000100:00100000:3.0:1788574237.110298:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686656 00000100:00100000:3.0:1788574237.110406:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 111 00000100:00100000:3.0:1788574237.110418:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:10542:x1875455727686656:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574237.110441:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.110465:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3926 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.110533:0:10109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.110545:0:10109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 55 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.110564:0:10109:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.110578:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 55 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.110592:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574237.110595:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574237.110599:0:10109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 55 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.110620:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7a00, rc 0) 00000100:00100000:3.0:1788574237.110691:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10542:x1875455727686656:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 266us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.110698:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 111 00000040:00080000:0.0:1788574237.443020:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574237.443031:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574237.446680:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788574237.446705:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574237.448452:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793286300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747625216:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574237.448658:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e2b6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.454955:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793286300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747625216:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574237.459131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.459739:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686784 00000100:00100000:2.0:1788574237.459768:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686784 00000100:00100000:2.0:1788574237.459869:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 112 00000100:00100000:2.0:1788574237.459883:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10543:x1875455727686784:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788574237.459933:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788574237.460109:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10543:x1875455727686784:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 228us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.460118:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 112 00000100:00100000:0.0:1788574237.472745:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.472937:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727686912 00000100:00100000:2.0:1788574237.472949:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727686912 00000100:00100000:2.0:1788574237.473025:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:2.0:1788574237.473037:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10543:x1875455727686912:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788574237.473606:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.473626:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.473638:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.473718:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.473726:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.473734:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.476400:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477643:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477659:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574237.477716:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788574237.477721:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574237.477737:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477764:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477773:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477780:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477810:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574237.477825:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477833:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477849:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:2.0:1788574237.477852:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574237.477856:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477863:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b5360ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477883:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477889:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477895:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477899:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574237.477902:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477908:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477928:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff90a782d70e00) 00010000:00010000:2.0:1788574237.477930:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574237.477933:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477939:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536106 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477961:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477967:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477973:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477977:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574237.477979:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.477985:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.478002:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574237.478004:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574237.478007:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.478014:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53610d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.478154:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10543:x1875455727686912:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 5105us (5405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.478166:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:0.0:1788574237.481621:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.481836:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727687168 00000100:00100000:3.0:1788574237.481847:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727687168 00000100:00100000:3.0:1788574237.481921:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:3.0:1788574237.481935:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:10543:x1875455727687168:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.481964:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.481993:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536114 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce392d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482158:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482180:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482196:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574237.482209:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788574237.482417:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482426:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482446:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482453:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574237.482458:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482468:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482496:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574237.482500:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574237.482506:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482513:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53611b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482577:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536114 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce392d expref: 57 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482589:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574237.482591:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574237.482596:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536114 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce392d expref: 57 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.482608:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6a00, rc 0) 00000100:00100000:3.0:1788574237.499288:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10543:x1875455727687168:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 17344us (17667us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788574237.499323:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:1.0:1788574237.499802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.499969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.500334:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727687680 00000100:00100000:2.0:1788574237.500348:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727687680 00000100:00100000:2.0:1788574237.500462:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 142 00000100:00100000:2.0:1788574237.500484:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727687680:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574237.500564:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727687680:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 92us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.500571:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 142 00000100:00100000:1.0:1788574237.501314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.501428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.501457:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727687424 00000100:00100000:1.0:1788574237.501463:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727687424 00000100:00100000:1.0:1788574237.501580:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727687552 00000100:00100000:1.0:1788574237.501584:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727687552 00000100:00100000:1.0:1788574237.501610:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:1.0:1788574237.501619:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2353:x1875455727687424:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574237.501666:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2353:x1875455727687424:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 49us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.501749:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:1.0:1788574237.501765:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:1.0:1788574237.501771:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727687552:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574237.501794:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727687552:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.501815:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:2.0:1788574237.504917:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727687296 00000100:00100000:2.0:1788574237.504936:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727687296 00000100:00100000:2.0:1788574237.505029:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 292 00000100:00100000:2.0:1788574237.505040:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727687296:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574237.505127:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727687296:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 89us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.505135:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 292 00000100:00080000:1.0:1788574237.507119:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574237.507134:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574237.514721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.516268:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727687808 00000100:00100000:2.0:1788574237.516288:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727687808 00000100:00100000:2.0:1788574237.516421:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:2.0:1788574237.516433:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10543:x1875455727687808:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788574237.516468:0:11654:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788574237.516617:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10543:x1875455727687808:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 186us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.516640:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:1.0:1788574237.522724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.522979:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727688064 00000100:00100000:3.0:1788574237.522995:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727688064 00000100:00100000:3.0:1788574237.523074:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:3.0:1788574237.523086:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10543:x1875455727688064:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.523107:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.523111:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574237.523149:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b5360b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3911 expref: 56 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.523172:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574237.523179:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574237.523195:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536129 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3934 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574237.523759:0:5859:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788574237.523988:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.524005:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.524018:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.524078:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3934 expref: 58 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.524119:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3934 expref: 57 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.524127:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37200) 00010000:00010000:3.0:1788574237.524130:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574237.524133:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6000, rc 0) 00000100:00100000:3.0:1788574237.524217:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10543:x1875455727688064:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1133us (1506us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788574237.524226:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:1.0:1788574237.533621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.533832:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727688320 00000100:00100000:0.0:1788574237.533844:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727688320 00000100:00100000:0.0:1788574237.533921:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:0.0:1788574237.533933:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10543:x1875455727688320:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.534020:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574237.534055:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b536130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3934 expref: 57 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534079:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37200) 00010000:00010000:0.0:1788574237.534093:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574237.534123:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534151:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534162:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534180:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534203:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534209:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534272:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534279:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534286:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534293:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574237.534297:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534305:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534313:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574237.534316:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574237.534320:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534326:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53613e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534348:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534360:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534366:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534419:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574237.534423:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534429:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534438:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7514c8bb (ffff90a78544f600) 00010000:00010000:0.0:1788574237.534441:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574237.534444:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.534450:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7514c8bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.534526:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10543:x1875455727688320:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 595us (917us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574237.534534:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:0.0:1788574237.537666:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.537754:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727688448 00000100:00100000:3.0:1788574237.537766:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727688448 00000100:00100000:3.0:1788574237.537835:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:3.0:1788574237.537848:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:10543:x1875455727688448:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.537879:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.537912:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53614c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce393b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.537963:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.537980:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.537995:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.538135:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53614c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.538174:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.538183:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574237.538186:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574237.538189:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6a00, rc 0) 00000100:00100000:3.0:1788574237.538245:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10543:x1875455727688448:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 401us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.538251:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:1.0:1788574237.541614:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.541719:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727688704 00000100:00100000:2.0:1788574237.541729:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727688704 00000100:00100000:2.0:1788574237.541785:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:2.0:1788574237.541795:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:10543:x1875455727688704:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574237.541880:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.541895:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.541906:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574237.542173:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788574237.542183:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363716814426ns, next at 364716811715ns, rc = 0 00000004:00010000:2.0:1788574237.542267:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7a2586d reply state 000000001bad7b64 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.542276:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574237.542414:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:10543:x1875455727688704:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 619us (807us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788574237.542421:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00010000:00010000:3.0:1788574237.548729:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.548751:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.548759:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.548765:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574237.548771:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.548781:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.548802:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574237.548805:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574237.548811:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.548839:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53615a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.549207:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.549906:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727688832 00000100:00100000:2.0:1788574237.549919:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727688832 00000100:00100000:2.0:1788574237.550001:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:2.0:1788574237.550021:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:10543:x1875455727688832:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574237.550053:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574237.550093:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3942 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.550186:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 59 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.550202:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 59 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.550223:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:2.0:1788574237.550226:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574237.550230:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984000, rc 0) 00000100:00100000:2.0:1788574237.550302:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:10543:x1875455727688832:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 282us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.550309:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:1.0:1788574237.552994:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.554206:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727688960 00000100:00100000:3.0:1788574237.554225:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727688960 00000100:00100000:3.0:1788574237.554308:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:3.0:1788574237.554320:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727688960:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788574237.554707:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727688960:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 388us (1727us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788574237.554715:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788574237.560070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.560331:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727689216 00000100:00100000:0.0:1788574237.560341:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727689216 00000100:00100000:0.0:1788574237.560437:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:0.0:1788574237.560449:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:10543:x1875455727689216:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574237.560715:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:10543:x1875455727689216:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 268us (656us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788574237.560723:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:0.0:1788574237.567619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.567773:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727689472 00000100:00100000:2.0:1788574237.567783:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727689472 00000100:00100000:2.0:1788574237.567857:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:2.0:1788574237.567870:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:10543:x1875455727689472:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574237.568036:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:10543:x1875455727689472:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.568045:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:1.0:1788574237.572241:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.572345:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727689600 00000100:00100000:0.0:1788574237.572357:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727689600 00000100:00100000:0.0:1788574237.572497:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:0.0:1788574237.572508:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:10543:x1875455727689600:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.572529:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574237.572552:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3949 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.572649:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b53616f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.572664:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b53616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.572689:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b53616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574237.572727:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574237.572746:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b53616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.572771:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3949 expref: 62 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.572789:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b53616f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3949 expref: 61 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.572805:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574237.572807:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788574237.572811:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d000, rc 0) 00000100:00100000:0.0:1788574237.572868:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:10543:x1875455727689600:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 363us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.572875:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:1.0:1788574237.578174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.579016:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727689728 00000100:00100000:3.0:1788574237.579029:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727689728 00000100:00100000:3.0:1788574237.579096:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788574237.579108:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2356:x1875455727689728:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.579128:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.579161:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3950 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574237.579190:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a1d, blocks: 0x1 00010000:00010000:3.0:1788574237.579210:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1788574237.579214:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574237.579224:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.579241:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.579269:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6e00, rc 0) 00000100:00100000:3.0:1788574237.579333:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2356:x1875455727689728:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 228us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.579340:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:1.0:1788574237.584347:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.584606:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727689984 00000100:00100000:3.0:1788574237.584618:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727689984 00000100:00100000:3.0:1788574237.584697:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:3.0:1788574237.584709:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:10543:x1875455727689984:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788574237.584837:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:10543:x1875455727689984:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 130us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.584846:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:1.0:1788574237.590318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.590464:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727690112 00000100:00100000:3.0:1788574237.590474:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727690112 00000100:00100000:3.0:1788574237.590539:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788574237.590551:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:10543:x1875455727690112:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.590573:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.590594:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3957 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.590630:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.590639:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574237.590644:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574237.590660:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.590710:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.590725:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.590741:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6712:1875455747625344:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574237.591258:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574237.605566:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6712:1875455747625344:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574237.605604:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.605626:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7200, rc 0) 00000100:00100000:3.0:1788574237.605693:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:10543:x1875455727690112:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 15143us (15391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.605702:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:0.0:1788574237.608534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.608641:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727690240 00000100:00100000:1.0:1788574237.608655:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727690240 00010000:00010000:1.0:1788574237.608720:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.608772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:1.0:1788574237.608784:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792608850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:2355:x1875455727690240:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574237.608802:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574237.608825:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.608840:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.608883:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536176 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3950 expref: 11 pid: 6713 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.608901:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574237.608905:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574237.608914:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 10 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.608923:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 10 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.608964:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 10 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.608981:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5844:1875455747625472:192.168.201.57@tcp:105: 00000100:00100000:1.0:1788574237.609078:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.619266:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5844:1875455747625472:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788574237.619298:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574237.619396:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792608850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2355:x1875455727690240:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 10584us (10845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.619411:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788574237.633153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.633536:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727690368 00000100:00100000:2.0:1788574237.633553:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727690368 00002000:00100000:2.0:1788574237.633633:0:6719:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90a7a72b9f80 x1875455727690368/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:388/0 lens 504/0 e 0 to 0 dl 1788574248 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574237.633652:0:6719:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a72b9f80 with x1875455727690368 ext(0->12) 00002000:00010000:2.0:1788574237.633661:0:6719:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7a72b9f80 00000100:00100000:2.0:1788574237.633704:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574237.633715:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2356:x1875455727690368:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788574237.634404:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:2356:x1875455727690368:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 688us (1270us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788574237.634413:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00002000:00100000:2.0:1788574237.634421:0:6719:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90a7a72b9f80 x1875455727690368/t4294967308(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:388/0 lens 504/448 e 0 to 0 dl 1788574248 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574237.634429:0:6719:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a72b9f80 with x1875455727690368 ext(0->12) 00002000:00010000:2.0:1788574237.634434:0:6719:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7a72b9f80 00000100:00100000:1.0:1788574237.647950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.648050:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727690496 00000100:00100000:0.0:1788574237.648063:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727690496 00000100:00100000:0.0:1788574237.648130:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788574237.648242:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:10543:x1875455727690496:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788574237.724624:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:10543:x1875455727690496:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 76375us (76672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.724638:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000001:00080000:3.0:1788574237.727071:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1788574237.727115:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7bb7e0c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788574237.727121:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7bbd8e100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7bb7e09c0 00000020:00080000:3.0:1788574237.727124:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7bbd8e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a79218f000 00000020:00080000:3.0:1788574237.727161:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1788574237.727183:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788574237.727240:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788574237.727251:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7a74fa9c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788574237.727254:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7a7bd7600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7a74fa600 00000020:00080000:3.0:1788574237.727257:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7a7bd7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a7bfb27800 00000004:00080000:3.0:1788574237.727276:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788574237.727707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.727739:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747625600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788574237.727784:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574237.727838:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574237.727845:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747625728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788574237.727866:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574237.727898:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727690624 00000100:00100000:1.0:1788574237.727911:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727690624 00000100:00100000:1.0:1788574237.727950:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747625600 00000100:00100000:1.0:1788574237.727953:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747625600 00000100:00100000:1.0:1788574237.727963:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747625728 00000100:00100000:1.0:1788574237.727965:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747625728 00000100:00100000:1.0:1788574237.727978:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:1.0:1788574237.727986:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:2356:x1875455727690624:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788574237.728052:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574237.728059:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875455747625600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788574237.728073:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788574237.728093:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.728114:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 12 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.728122:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788574237.728126:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574237.728130:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.728170:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 12 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.728184:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 12 pid: 10306 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.728207:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1875455747625856:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574237.728259:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b1a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574237.730359:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747625984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788574237.730453:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574237.730514:0:6712:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788574237.730523:0:6712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788574237.730629:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747625984 00000100:00100000:0.0:1788574237.730636:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747625984 00000100:00100000:0.0:1788574237.730752:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574237.730762:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1875455747625728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788574237.730908:0:12090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788574237.730912:0:12090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788574237 00002000:00010000:0.0:1788574237.730915:0:12090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788574237.730917:0:12090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788574237 -> 1788574237 00002000:00010000:0.0:1788574237.730919:0:12090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788574237.730969:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3314:x1875455747625728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (3101us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788574237.730977:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1788574237.731018:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7bb28c380/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788574237.731025:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747625728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788574237.731041:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788574237.731048:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747625984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788574237.731062:0:12090:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788574237.731087:0:12090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b7a1c, atime: 0x6a9b7a1c, ctime: 0x6a9b7a1c, blocks: 0x1 00010000:00010000:0.0:1788574237.731094:0:12090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731108:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788574237.731112:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574237.731119:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731148:0:12090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731159:0:12090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731165:0:12090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731194:0:12090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574237.731207:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574237.731213:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731220:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574237.731226:0:6727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731236:0:6727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731251:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731258:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b53618b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.731273:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574237.731275:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574237.731276:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574237.731838:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1875455747625984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 789us (1383us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788574237.731847:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1788574237.731876:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7bb288a80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788574237.731882:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747625984:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788574237.732208:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788574237.732338:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788574237.734528:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1875455747625856:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574237.734569:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.746474:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.746558:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727690752 00000100:00100000:2.0:1788574237.746575:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727690752 00010000:00010000:2.0:1788574237.746613:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 13 pid: 10306 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.746669:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:2.0:1788574237.746680:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:2356:x1875455727690752:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574237.746694:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574237.746699:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 13 pid: 10306 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746714:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 13 pid: 10306 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746734:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b71ef7a4/0x10531a153b535f46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce38b6 expref: 13 pid: 10306 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746750:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574237.746754:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574237.746760:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746770:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746798:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574237.746848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:2356:x1875455727690752:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 170us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.746865:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00010000:00010000:2.0:1788574237.746892:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746902:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746912:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746921:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.746935:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788574237.747487:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875455747625600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19427us (19700us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788574237.747495:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788574237.747543:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7bb28dc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788574237.747549:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747625600:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788574237.748544:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574237.748558:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.748571:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574237.748577:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.748589:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.748611:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.748619:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a842df/0x10531a153b536184 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.748642:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574237.748645:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574237.748646:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788574237.812644:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788574237.812659:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788574237.812676:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788574237.812986:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727690624:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 84995us (85278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.812997:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:1.0:1788574237.815286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.815419:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727691008 00000100:00100000:2.0:1788574237.815431:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727691008 00000100:00100000:2.0:1788574237.815489:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:2.0:1788574237.815499:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:10543:x1875455727691008:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574237.815552:0:11654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574237.815577:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b53616f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3949 expref: 15 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.815609:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:2.0:1788574237.815614:0:11654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574237.815643:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.815656:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.815677:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574237.815933:0:11654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031abed9a reply state 00000000cb848e25 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.815943:0:11654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574237.816474:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:10543:x1875455727691008:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 973us (1196us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788574237.816483:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:1.0:1788574237.821676:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788574237.821761:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.821774:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.821782:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.821788:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574237.821793:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.821801:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.821817:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574237.821820:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574237.821825:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.821831:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536192 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.821897:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727691136 00000100:00100000:0.0:1788574237.821906:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727691136 00000100:00100000:0.0:1788574237.821957:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:0.0:1788574237.821966:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727691136:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788574237.822186:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788574237.822190:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788574237 -> 1788574237 00002000:00010000:0.0:1788574237.822192:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788574236 00002000:00010000:0.0:1788574237.822194:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788574237 -> 1788574237 00002000:00010000:0.0:1788574237.822196:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788574237.822257:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727691136:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 291us (593us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788574237.822264:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:2.0:1788574237.825013:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.825085:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727691392 00000100:00100000:3.0:1788574237.825096:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727691392 00000100:00100000:3.0:1788574237.825158:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:3.0:1788574237.825168:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:10543:x1875455727691392:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.825239:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.825256:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.825266:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.825300:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.825312:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 15 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.825326:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747626112:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574237.825449:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574237.833725:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747626112:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574237.833761:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.833975:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.834183:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727691520 00000100:00100000:1.0:1788574237.834192:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727691520 00010000:00010000:1.0:1788574237.834230:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 16 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.834268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788574237.834279:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:2355:x1875455727691520:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574237.834294:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574237.834301:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 16 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.834315:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 16 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.834357:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce393b expref: 16 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.834431:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:1.0:1788574237.834437:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.834449:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.834458:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.834487:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574237.834554:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:2355:x1875455727691520:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 277us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.834580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00010000:00010000:3.0:1788574237.835024:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835047:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835083:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835090:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835097:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835103:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574237.835107:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835115:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835125:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574237.835127:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788574237.835131:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.835164:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536199 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.835229:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:10543:x1875455727691392:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 10061us (10231us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788574237.835238:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:2.0:1788574237.839056:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.839163:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727691648 00000100:00100000:0.0:1788574237.839174:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727691648 00000100:00100000:0.0:1788574237.839236:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:0.0:1788574237.839247:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727691648:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.839298:0:12090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.839320:0:12090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.839329:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788574237.839348:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574237.839353:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.839436:0:12090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.839452:0:12090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 7 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.839467:0:12090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12090:1875455747626240:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574237.839551:0:12090:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574237.848679:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.848888:0:12090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12090:1875455747626240:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574237.848919:0:12090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.849017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727691776 00000100:00100000:2.0:1788574237.849025:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727691776 00010000:00010000:2.0:1788574237.849067:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 8 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.849109:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:2.0:1788574237.849119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727691776:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574237.849164:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574237.849190:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 8 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.849204:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 8 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.849229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e99bcc4/0x10531a153b53617d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3957 expref: 8 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.849250:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574237.849255:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574237.849261:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.849270:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.849301:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574237.849573:0:12090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849583:0:12090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849606:0:12090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849615:0:12090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849629:0:12090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849637:0:12090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574237.849642:0:12090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849651:0:12090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849673:0:12090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.849683:0:12090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000031c4a12/0x10531a153b5361a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.849823:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727691776:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 702us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.849833:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:2.0:1788574237.861542:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727691648:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 22281us (22480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.861559:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:1.0:1788574237.871935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.872028:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727692032 00000100:00100000:0.0:1788574237.872039:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727692032 00000100:00100000:0.0:1788574237.872104:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 127 00000100:00100000:0.0:1788574237.872117:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:10543:x1875455727692032:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.872204:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872222:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872250:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872490:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872502:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 15 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872512:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872545:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 15 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.872559:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 15 pid: 11654 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.872574:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747626368:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574237.872650:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574237.875890:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.876389:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747626368:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574237.876418:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.876578:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727692160 00000100:00100000:3.0:1788574237.876585:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727692160 00010000:00010000:3.0:1788574237.876622:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 16 pid: 11654 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.876660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:3.0:1788574237.876677:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:2355:x1875455727692160:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574237.876690:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574237.876697:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 16 pid: 11654 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.876709:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 16 pid: 11654 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.876730:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3942 expref: 16 pid: 11654 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.876756:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574237.876761:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.876771:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.876779:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.876798:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574237.876844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:2355:x1875455727692160:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 168us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.876864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00010000:00010000:0.0:1788574237.877912:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.877928:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574237.878127:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788574237.878284:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788574237.878468:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788574237.878577:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747626496:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574237.878635:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574237.879066:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574237.879147:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747626496 00000100:00100000:3.0:1788574237.879154:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747626496 00000100:00100000:3.0:1788574237.879208:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574237.879219:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747626496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574237.879311:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747626496:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.879317:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574237.879792:0:5858:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788574237.879798:0:5858:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788574237.879816:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7bb28c380, transno 4294967309 00000100:00100000:1.0:1788574237.879836:0:5858:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90a7bb28dc00 x1875455747625600/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788574253 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574237.879847:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747626496:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788574237.880302:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788574237.884720:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747626624:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788574237.884799:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574237.884837:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574237.885157:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747626624 00000100:00100000:0.0:1788574237.885164:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747626624 00000100:00100000:0.0:1788574237.885210:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574237.885220:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747626624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574237.885483:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5858:x1875455747626624:12345-0@lo:1000:mdt00_001.0 Request processed in 263us (683us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788574237.885491:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574237.885537:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747626624:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788574237.885572:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885582:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885588:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885594:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574237.885598:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885605:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885632:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574237.885635:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574237.885639:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885646:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885690:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885697:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885702:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885707:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574237.885710:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885715:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885723:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574237.885725:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574237.885731:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885751:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885766:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.885794:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.885804:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747626752:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574237.885865:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574237.891537:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574237.891706:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747626752:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788574237.891971:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.891986:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5360f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892039:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892060:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892073:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892088:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892095:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892123:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892129:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574237.892143:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892151:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892164:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574237.892168:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574237.892172:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892177:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892188:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892194:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892200:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892205:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574237.892208:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892225:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892234:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574237.892237:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574237.892240:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.892246:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b5361a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.892532:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:10543:x1875455727692032:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 20415us (20609us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788574237.892542:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 127 00000020:00080000:0.0:1788574237.892547:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788574237.894338:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574237.894348:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574237.894969:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788574237.894981:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574237.895422:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727692288 00000100:00100000:1.0:1788574237.895435:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727692288 00000100:00100000:1.0:1788574237.895500:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:1.0:1788574237.895510:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:10542:x1875455727692288:12345-192.168.201.57@tcp:49:lfs.0 00000100:00100000:1.0:1788574237.895682:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:10542:x1875455727692288:12345-192.168.201.57@tcp:49:lfs.0 Request processed in 172us (4160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.895700:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788574237.899975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.900114:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727692544 00000100:00100000:1.0:1788574237.900126:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727692544 00000100:00100000:1.0:1788574237.900195:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:1.0:1788574237.900207:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785621450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:10543:x1875455727692544:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574237.902098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.902966:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727692800 00000100:00100000:3.0:1788574237.902979:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727692800 00000100:00100000:3.0:1788574237.903048:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:3.0:1788574237.903058:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:10542:x1875455727692800:12345-192.168.201.57@tcp:58:lfs.0 00000004:00080000:1.0:1788574237.905469:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788574237.905568:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788574237.905655:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.905671:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.905682:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.905691:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.905697:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.905703:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.905747:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788574237.905879:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785621450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10543:x1875455727692544:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 5669us (5907us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788574237.905889:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000020:00080000:1.0:1788574237.905894:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788574237.906182:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574237.906191:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.906199:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574237.906213:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.906222:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.906240:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90a7b2398c00) 00010000:00010000:0.0:1788574237.906243:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788574237.906257:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.906264:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b5361bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.906284:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574237.906286:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574237.906288:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574237.907311:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788574237.907406:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:10542:x1875455727692800:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 4345us (5311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.907417:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:0.0:1788574237.970586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574237.970887:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727692928 00000100:00100000:3.0:1788574237.970898:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727692928 00000100:00100000:3.0:1788574237.970967:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:3.0:1788574237.970978:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:10545:x1875455727692928:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574237.971017:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.971054:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5361c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce395e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971120:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971145:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971158:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971174:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971180:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971187:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971467:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971478:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971486:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971521:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.971549:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 21 pid: 5858 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.971563:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747626880:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574237.972541:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.977969:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574237.978143:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727693184 00000100:00100000:1.0:1788574237.978154:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727693184 00000100:00100000:1.0:1788574237.978217:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:1.0:1788574237.978229:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:5593:x1875455727693184:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788574237.978526:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:5593:x1875455727693184:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 298us (566us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788574237.978541:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:3.0:1788574237.982327:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747626880:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574237.982475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574237.982577:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727693312 00000100:00100000:2.0:1788574237.982586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727693312 00010000:00010000:2.0:1788574237.982626:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 23 pid: 5858 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.982684:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:2.0:1788574237.982695:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:2356:x1875455727693312:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574237.982712:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574237.982720:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 23 pid: 5858 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.982734:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 23 pid: 5858 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.982776:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5360e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce391f expref: 23 pid: 5858 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.982796:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574237.982803:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.982814:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.982823:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.982847:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574237.982916:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2356:x1875455727693312:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 222us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.982940:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00010000:00010000:3.0:1788574237.983892:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984196:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984205:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574237.984249:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788574237.984254:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574237.984274:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984287:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984297:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984303:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984310:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984317:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574237.984321:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984829:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984847:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:2.0:1788574237.984866:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574237.984873:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984880:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5361ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984896:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984902:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984909:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984914:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574237.984917:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984923:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984931:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90a784e37300) 00010000:00010000:2.0:1788574237.984934:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574237.984937:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984942:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5361d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984988:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b5361c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce395e expref: 22 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.985091:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce395e expref: 21 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.985099:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574237.985101:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574237.985104:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7600, rc 0) 00000100:00100000:2.0:1788574237.985232:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10545:x1875455727692928:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 14255us (14656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.985240:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 129 00010000:00010000:0.0:1788574238.016970:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574238.849690:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747627264:0@lo:400:kworker.0 00000100:00100000:3.0:1788574238.849775:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574238.849843:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788574238.849849:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747627136:0@lo:400:kworker.0 00000100:00100000:3.0:1788574238.849872:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574238.849888:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a681831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747627648:0@lo:400:kworker.0 00000100:00100000:3.0:1788574238.849909:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574238.849944:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627648 00000100:00100000:3.0:1788574238.849951:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627648 00000100:00100000:3.0:1788574238.850008:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788574238.850020:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747627648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574238.850077:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747627648:12345-0@lo:400:kworker.0 Request processed in 60us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574238.850085:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788574238.850109:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574238.850166:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a681831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747627648:0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850281:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747627008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850323:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574238.850353:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a681831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747627520:0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850438:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574238.850465:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574238.850471:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747627392:0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850497:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574238.850533:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627264 00000100:00100000:0.0:1788574238.850538:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627264 00000100:00100000:0.0:1788574238.850579:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627136 00000100:00100000:0.0:1788574238.850582:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627136 00000100:00100000:0.0:1788574238.850600:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627520 00000100:00100000:0.0:1788574238.850603:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627520 00000100:00100000:0.0:1788574238.850618:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788574238.850624:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747627264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850664:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747627264:12345-0@lo:400:kworker.0 Request processed in 41us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.850669:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788574238.850691:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788574238.850697:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747627136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850724:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747627136:12345-0@lo:400:kworker.0 Request processed in 28us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.850730:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788574238.850740:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788574238.850746:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850777:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747627520:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.850782:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788574238.850807:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627392 00000100:00100000:0.0:1788574238.850811:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627392 00000100:00100000:0.0:1788574238.850835:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788574238.850841:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747627392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850868:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747627392:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.850873:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788574238.850889:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627008 00000100:00100000:0.0:1788574238.850892:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627008 00000100:00100000:0.0:1788574238.850916:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788574238.850922:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747627008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.850951:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747627008:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.850957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1788574238.851002:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574238.851007:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574238.851049:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747627392:0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.851071:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747627008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574238.851080:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a681831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747627520:0@lo:400:kworker.0 00000100:00100000:3.0:1788574238.851563:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747627136:0@lo:400:kworker.0 00000100:00100000:3.0:1788574238.851577:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747627264:0@lo:400:kworker.0 00000040:00080000:3.0:1788574238.913613:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574238.913623:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574238.913699:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788574238.913707:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574238.913835:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a681831880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747627776:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574238.913945:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574238.919945:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574238.920082:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a681831880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747627776:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574238.920123:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727693440 00000100:00100000:0.0:1788574238.920131:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727693440 00000100:00100000:0.0:1788574238.920185:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:0.0:1788574238.920194:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10556:x1875455727693440:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574238.920226:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574238.920328:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10556:x1875455727693440:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.920337:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:3.0:1788574238.924683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574238.924783:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727693696 00000100:00100000:0.0:1788574238.924800:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727693696 00000100:00100000:0.0:1788574238.924873:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 131 00000100:00100000:0.0:1788574238.924900:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:10556:x1875455727693696:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574238.924925:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574238.924955:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3965 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.925082:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.925102:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.925130:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574238.925165:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788574238.925302:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d000/0x10531a153b5361df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3965 expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.925325:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3965 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.925335:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574238.925337:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574238.925342:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ce00, rc 0) 00000100:00100000:0.0:1788574238.925441:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:10556:x1875455727693696:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 556us (766us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788574238.925448:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 131 00000100:00100000:2.0:1788574238.940998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574238.941065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727693824 00000100:00100000:0.0:1788574238.941074:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727693824 00000100:00100000:0.0:1788574238.941146:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788574238.941157:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:2356:x1875455727693824:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574238.941173:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574238.941197:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3965 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.941217:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574238.941223:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574238.941275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2356:x1875455727693824:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.941283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574238.953352:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574238.953458:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727694080 00000100:00100000:0.0:1788574238.953468:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727694080 00000100:00100000:0.0:1788574238.953531:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:0.0:1788574238.953542:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:10556:x1875455727694080:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788574238.953622:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953640:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953663:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953860:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953869:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953876:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953882:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574238.953897:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953905:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953918:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:0.0:1788574238.953921:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574238.953933:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.953938:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5361f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574238.954094:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:10556:x1875455727694080:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 553us (751us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788574238.954103:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 132 00000040:00080000:2.0:1788574238.954156:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574238.954161:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574238.955514:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788574238.955527:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574238.956694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574238.956764:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727694336 00000100:00100000:3.0:1788574238.956775:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727694336 00000100:00100000:3.0:1788574238.956836:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:3.0:1788574238.956846:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:10556:x1875455727694336:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788574238.957071:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:10556:x1875455727694336:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 226us (383us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788574238.957079:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00010000:00010000:1.0:1788574239.041626:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574239.072748:0:12129:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574239.072762:0:12129:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574239.072810:0:12129:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788574239.072817:0:12129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574239.370313:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a681831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747627904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574239.370439:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574239.370539:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747627904 00000100:00100000:3.0:1788574239.370548:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747627904 00000100:00100000:3.0:1788574239.370609:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574239.370619:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747627904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574239.370685:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574239.370822:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747627904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574239.370830:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574239.370886:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a681831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747627904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574239.433625:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574239.433680:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727694592 00000100:00100000:3.0:1788574239.433692:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727694592 00000100:00100000:2.0:1788574239.438479:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:2.0:1788574239.438503:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:10569:x1875455727694592:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574239.438535:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788574239.438888:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574239.440315:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5361fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce396c expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.440673:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b536202 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.440690:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b536202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.440710:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b536202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574239.440724:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788574239.440873:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5361fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce396c expref: 27 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.440891:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b536202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce396c expref: 26 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.440900:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:2.0:1788574239.440903:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788574239.440907:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984c00, rc 0) 00000100:00100000:2.0:1788574239.440983:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:10569:x1875455727694592:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 2489us (7371us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788574239.440993:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:3.0:1788574239.449785:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574239.449951:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727694720 00000100:00100000:1.0:1788574239.449962:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727694720 00000100:00100000:1.0:1788574239.450036:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:1.0:1788574239.450049:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:10569:x1875455727694720:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788574239.450157:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450180:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450194:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450225:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450232:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450238:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450243:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574239.450248:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450264:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450278:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:1.0:1788574239.450282:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574239.450286:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.450293:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574239.450425:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:10569:x1875455727694720:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 378us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574239.450434:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 134 00000001:00080000:1.0:1788574239.453432:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788574239.453621:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788574239.569644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574239.573483:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727694848 00000100:00100000:0.0:1788574239.573500:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727694848 00000100:00100000:0.0:1788574239.573717:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:0.0:1788574239.573730:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727694848:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:0.0:1788574239.573748:0:12090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574239.573767:0:12090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000424232fa/0x10531a153b536217 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3973 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788574239.573796:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1788574239.573796:0:12090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b7a1d, atime: 0x6a9b7a1c, ctime: 0x6a9b7a1d, blocks: 0xb 00010000:00010000:0.0:1788574239.573817:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788574239.573821:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574239.573830:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424232fa/0x10531a153b536217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3973 expref: 7 pid: 12090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.573850:0:12090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000424232fa/0x10531a153b536217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3973 expref: 7 pid: 12090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.573881:0:12090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d000, rc 0) 00000100:00100000:0.0:1788574239.574202:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727694848:12345-192.168.201.57@tcp:101:cat.0 Request processed in 474us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574239.574211:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:1.0:1788574239.588762:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574239.588850:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727694976 00000100:00100000:2.0:1788574239.588865:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727694976 00002000:00100000:2.0:1788574239.588936:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff90a7a77a6680 x1875455727694976/t0(0) o3->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:390/0 lens 488/0 e 0 to 0 dl 1788574250 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574239.588959:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a77a6680 with x1875455727694976 ext(0->4095) 00002000:00010000:2.0:1788574239.588967:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7a77a6680 00000100:00100000:2.0:1788574239.589006:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:2.0:1788574239.589016:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727694976:12345-192.168.201.57@tcp:3:cat.0 00000100:00100000:2.0:1788574239.589334:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727694976:12345-192.168.201.57@tcp:3:cat.0 Request processed in 318us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788574239.589351:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00002000:00100000:2.0:1788574239.589358:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff90a7a77a6680 x1875455727694976/t0(0) o3->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:390/0 lens 488/4536 e 0 to 0 dl 1788574250 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574239.589395:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7a77a6680 with x1875455727694976 ext(0->4095) 00002000:00010000:2.0:1788574239.589399:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7a77a6680 00010000:00010000:0.0:1788574240.064565:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574241.098678:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574241.920641:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747628032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574241.920711:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.920943:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628032 00000100:00100000:3.0:1788574241.920960:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628032 00000100:00100000:3.0:1788574241.921037:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574241.921047:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875455747628032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574241.921090:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574241.921148:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875455747628032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.921156:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788574241.921274:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574241.921304:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747628032:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788574242.052479:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574242.052488:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574242.052523:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788574242.052529:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788574242.112921:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574242.607416:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574242.607452:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574242.607491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574242.607516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574242.607537:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574242.607563:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727695616 00000100:00100000:3.0:1788574242.607572:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727695616 00000100:00100000:3.0:1788574242.607630:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727695232 00000100:00100000:3.0:1788574242.607633:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727695232 00000100:00100000:2.0:1788574242.608867:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727695360 00000100:00100000:2.0:1788574242.608882:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727695360 00000100:00100000:2.0:1788574242.608950:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727695488 00000100:00100000:2.0:1788574242.608954:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727695488 00000100:00100000:2.0:1788574242.608990:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:2.0:1788574242.609003:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727695360:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574242.609114:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727695360:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 114us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574242.609123:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:2.0:1788574242.609143:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:2.0:1788574242.609151:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727695488:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574242.609176:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2353:x1875455727695488:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574242.609191:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00080000:2.0:1788574242.609479:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574242.609484:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574242.609486:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574242.609506:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 146 00000100:00100000:2.0:1788574242.609515:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727695616:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574242.609551:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2353:x1875455727695616:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 37us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574242.609558:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 146 00000100:00100000:2.0:1788574242.609576:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 147 00000100:00100000:2.0:1788574242.611011:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:2353:x1875455727695232:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574242.611128:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:2353:x1875455727695232:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 139us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574242.611152:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 147 00000100:00100000:1.0:1788574242.614734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727695104 00000100:00100000:1.0:1788574242.614754:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727695104 00000100:00100000:1.0:1788574242.614815:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 294 00000100:00100000:1.0:1788574242.614826:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727695104:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574242.614908:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2353:x1875455727695104:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 84us (7539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574242.614915:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 294 00000001:00080000:2.0:1788574243.051072:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1788574243.051114:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7bb7e0cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788574243.051120:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a782d1ba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7bb7e09c0 00000020:00080000:2.0:1788574243.051124:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a782d1b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a79e8c0c00 00000001:00080000:2.0:1788574243.051137:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788574243.051146:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788574243.051165:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788574243.051690:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788574243.108772:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788574243.108785:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788574243.136578:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574243.969769:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747628160:0@lo:400:kworker.0 00000100:00100000:2.0:1788574243.969860:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574243.969925:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788574243.969951:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574243.969982:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574243.969988:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747628544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574243.970012:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574243.970294:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628160 00000100:00100000:0.0:1788574243.970303:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628160 00000100:00100000:0.0:1788574243.970354:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788574243.970364:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747628160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574243.970442:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747628160:12345-0@lo:400:kworker.0 Request processed in 79us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574243.970449:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788574243.970535:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628544 00000100:00100000:0.0:1788574243.970539:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628544 00000100:00100000:0.0:1788574243.970571:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574243.970577:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747628544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574243.970606:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747628544:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574243.970612:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574243.970642:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788574243.970647:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7bb28dc00, transno 4294967310 00000004:00080000:0.0:1788574243.970656:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788574243.970679:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747628544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574243.970703:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747628160:0@lo:400:kworker.0 00000100:00100000:1.0:1788574243.971411:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628672 00000100:00100000:1.0:1788574243.971426:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628672 00000100:00100000:1.0:1788574243.971465:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788574243.971492:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747628672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574243.971543:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747628672:12345-0@lo:400:kworker.0 Request processed in 61us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574243.971549:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788574243.971581:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747628672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574243.971755:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747628288:0@lo:400:kworker.0 00000100:00100000:3.0:1788574243.971790:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574243.971830:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747628800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574243.971857:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574243.971877:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574243.971883:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747628416:0@lo:400:kworker.0 00000100:00100000:3.0:1788574243.971904:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574243.972260:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628800 00000100:00100000:3.0:1788574243.972265:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628800 00000100:00100000:3.0:1788574243.972293:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788574243.972299:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747628800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574243.972337:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747628800:12345-0@lo:400:kworker.0 Request processed in 38us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574243.972343:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788574243.972394:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788574243.972399:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788574243.972410:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7bb288a80, transno 4294967304 00000100:00100000:3.0:1788574243.972421:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747628800:0@lo:400:kworker.0 00000100:00080000:2.0:1788574243.973075:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574243.973092:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574243.973095:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574243.973109:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628288 00000100:00100000:2.0:1788574243.973114:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628288 00000100:00100000:2.0:1788574243.973144:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628416 00000100:00100000:2.0:1788574243.973156:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628416 00000100:00100000:2.0:1788574243.973185:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574243.973194:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747628288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574243.973258:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747628288:12345-0@lo:400:kworker.0 Request processed in 65us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574243.973265:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574243.973281:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788574243.973287:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747628416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574243.973311:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747628416:12345-0@lo:400:kworker.0 Request processed in 25us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574243.973316:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788574243.973330:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574243.973400:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747628416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574243.973414:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747628288:0@lo:400:kworker.0 00010000:00010000:0.0:1788574244.163013:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574244.493843:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747628928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574244.493993:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574244.495718:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747628928 00000100:00100000:2.0:1788574244.495732:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747628928 00000100:00100000:2.0:1788574244.495785:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574244.495794:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747628928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574244.495831:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574244.501614:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747628928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5807us (7607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574244.501632:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574244.507942:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747628928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788574245.184766:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574245.447640:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574245.451501:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727695744 00000100:00100000:2.0:1788574245.451518:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727695744 00000100:00100000:2.0:1788574245.451621:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00100000:2.0:1788574245.451634:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10221:x1875455727695744:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788574245.451772:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10221:x1875455727695744:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 Request processed in 141us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574245.451781:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00080000:0.0:1788574245.454216:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574245.467024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574245.467067:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696000 00000100:00100000:1.0:1788574245.467079:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696000 00000100:00100000:1.0:1788574245.467131:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:1.0:1788574245.467151:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:10221:x1875455727696000:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574245.467609:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:10221:x1875455727696000:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 458us (607us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788574245.467617:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:2.0:1788574245.759919:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574245.760069:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696128 00000100:00100000:0.0:1788574245.760079:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696128 00000100:00080000:2.0:1788574245.760273:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574245.760318:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 136 00000100:00100000:0.0:1788574245.760340:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:11021:x1875455727696128:12345-192.168.201.57@tcp:101:lsof.0 00010000:00010000:0.0:1788574245.760403:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574245.760434:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53621e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce397a expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574245.760754:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574245.760770:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574245.760782:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574245.760818:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574245.760822:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574245.760872:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574245.760917:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53621e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 7 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574245.760937:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 6 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574245.760946:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:0.0:1788574245.760949:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574245.760953:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574245.761035:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:11021:x1875455727696128:12345-192.168.201.57@tcp:101:lsof.0 Request processed in 698us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574245.761041:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 136 00010000:00010000:0.0:1788574246.208602:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574247.041820:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574247.041848:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747629056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574247.041939:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574247.043160:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629056 00000100:00100000:2.0:1788574247.043177:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629056 00000100:00100000:2.0:1788574247.043272:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574247.043283:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747629056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574247.043320:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574247.043641:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747629056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574247.043873:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574247.043902:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747629056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574247.043910:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1788574247.232551:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574247.723894:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574247.723948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574247.723994:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574247.724036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574247.724073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574247.724107:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696768 00000100:00100000:3.0:1788574247.724118:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696768 00000100:00100000:3.0:1788574247.724180:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696384 00000100:00100000:3.0:1788574247.724201:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696384 00000100:00100000:3.0:1788574247.724232:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 151 00000100:00100000:3.0:1788574247.724243:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2354:x1875455727696768:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574247.724323:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2354:x1875455727696768:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574247.724327:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696256 00000100:00100000:3.0:1788574247.724330:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 151 00000100:00100000:1.0:1788574247.724331:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696256 00000100:00100000:3.0:1788574247.724346:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 152 00000100:00100000:3.0:1788574247.724351:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2354:x1875455727696384:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574247.724357:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 296 00000100:00100000:1.0:1788574247.724363:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727696256:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574247.724416:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2354:x1875455727696384:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 63us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574247.724416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727696256:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 54us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.724423:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 152 00000100:00100000:1.0:1788574247.724423:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 296 00000100:00100000:3.0:1788574247.724441:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696512 00000100:00100000:3.0:1788574247.724444:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696512 00000100:00100000:3.0:1788574247.724468:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727696640 00000100:00100000:3.0:1788574247.724471:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727696640 00000100:00080000:1.0:1788574247.724471:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574247.724481:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574247.724483:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574247.724491:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:3.0:1788574247.724497:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a681832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727696512:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574247.724521:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a681832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727696512:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.724527:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:3.0:1788574247.724537:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:3.0:1788574247.724543:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727696640:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574247.724565:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727696640:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.724571:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000001:00080000:2.0:1788574248.140454:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788574248.140499:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788574248.140567:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788574248.140581:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788574248.262457:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574249.094722:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747629184:0@lo:400:kworker.0 00000100:00100000:1.0:1788574249.095336:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574249.095613:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629184 00000100:00100000:2.0:1788574249.095624:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629184 00000100:00100000:2.0:1788574249.095684:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788574249.095694:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747629184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096081:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747629312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096119:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574249.096138:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747629824:0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096159:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574249.096179:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574249.096183:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747629440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096204:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574249.096228:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629824 00000100:00100000:3.0:1788574249.096232:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629824 00000100:00100000:3.0:1788574249.096268:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788574249.096275:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747629824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096325:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747629824:12345-0@lo:400:kworker.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.096332:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788574249.096353:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629312 00000100:00100000:3.0:1788574249.096357:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629312 00000100:00100000:3.0:1788574249.096401:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629440 00000100:00100000:3.0:1788574249.096405:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629440 00000100:00100000:3.0:1788574249.096424:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788574249.096430:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747629312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096461:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747629312:12345-0@lo:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.096467:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788574249.096491:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788574249.096498:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747629440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096524:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747629440:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.096544:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788574249.096561:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574249.096565:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574249.096602:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747629440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096614:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747629312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.096623:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747629824:0@lo:400:kworker.0 00000100:00100000:0.0:1788574249.096716:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747629568:0@lo:400:kworker.0 00000100:00100000:0.0:1788574249.096745:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574249.096771:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574249.096776:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747629696:0@lo:400:kworker.0 00000100:00100000:0.0:1788574249.096797:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574249.096851:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629696 00000100:00100000:0.0:1788574249.096861:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629696 00000100:00100000:0.0:1788574249.096902:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574249.096909:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747629696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574249.096955:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747629696:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574249.096961:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574249.096987:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747629696:0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.097549:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629568 00000100:00100000:3.0:1788574249.097555:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629568 00000100:00100000:3.0:1788574249.097594:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788574249.097603:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747629568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574249.097657:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747629568:12345-0@lo:400:kworker.0 Request processed in 56us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.097663:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788574249.097679:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574249.097682:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574249.097701:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747629568:0@lo:400:kworker.0 00000100:00100000:1.0:1788574249.104460:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747629184:0@lo:400:kworker.0 00000100:00100000:2.0:1788574249.105117:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747629184:12345-0@lo:400:kworker.0 Request processed in 8611us (8969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574249.105138:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00010000:0.0:1788574249.280541:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574249.603017:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574249.603041:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747629952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574249.603130:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574249.603198:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747629952 00000100:00100000:3.0:1788574249.603207:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747629952 00000100:00100000:3.0:1788574249.603263:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574249.603272:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747629952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574249.603328:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574249.603403:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747629952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.603422:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574249.603706:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747629952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574250.306830:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574250.311483:0:12334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:10:49 (1788574249) 00000100:00100000:2.0:1788574251.250233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574251.250590:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697024 00000100:00100000:3.0:1788574251.250607:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697024 00000100:00100000:3.0:1788574251.250719:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 137 00000100:00100000:3.0:1788574251.250734:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:11287:x1875455727697024:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574251.250762:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574251.250790:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b53622c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3981 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.250892:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.250919:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.250936:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.250954:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.250961:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.250967:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.251318:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536241 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.251337:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.251345:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574251.251356:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788574251.252076:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252090:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252097:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252104:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574251.252110:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252120:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252137:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574251.252141:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574251.252147:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252154:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536233 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252169:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252183:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252189:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252194:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574251.252197:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252203:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252211:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a784e37100) 00010000:00010000:3.0:1788574251.252213:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574251.252216:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.252221:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53623a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788574251.253492:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574251.254098:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b53622c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3981 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.254127:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536241 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3981 expref: 15 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574251.254138:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574251.254141:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574251.254154:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7c00, rc 0) 00000100:00100000:3.0:1788574251.254530:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:11287:x1875455727697024:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 3798us (4314us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788574251.254542:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 137 00000100:00100000:1.0:1788574251.272113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574251.272158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574251.272265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697280 00000100:00100000:2.0:1788574251.272275:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697280 00000100:00100000:0.0:1788574251.272430:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697152 00000100:00100000:0.0:1788574251.272445:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697152 00000100:00100000:2.0:1788574251.272474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574251.272491:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b104850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:2355:x1875455727697280:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574251.272509:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788574251.272524:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 138 00000100:00100000:0.0:1788574251.272539:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+16:11287:x1875455727697152:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00010000:00010000:2.0:1788574251.272547:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536241 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3981 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574251.272571:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:2.0:1788574251.272577:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574251.272637:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b104850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:2355:x1875455727697280:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 150us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574251.272646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:0.0:1788574251.272683:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:11287:x1875455727697152:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 146us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574251.272694:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 138 00010000:00010000:1.0:1788574251.328886:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574252.162512:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747630080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574252.162588:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574252.162675:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747630080 00000100:00100000:1.0:1788574252.162684:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747630080 00000100:00100000:1.0:1788574252.162810:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788574252.162822:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747630080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574252.162859:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574252.162916:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747630080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.162925:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788574252.163018:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574252.163069:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747630080:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788574252.289081:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574252.289090:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574252.293330:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788574252.293346:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788574252.355785:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574252.844999:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574252.845043:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574252.845083:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574252.845114:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574252.845146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574252.845186:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697920 00000100:00100000:0.0:1788574252.845199:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697920 00000100:00100000:0.0:1788574252.845269:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697536 00000100:00100000:0.0:1788574252.845272:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697536 00000100:00100000:0.0:1788574252.845297:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 156 00000100:00100000:0.0:1788574252.845308:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2356:x1875455727697920:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574252.845563:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697664 00000100:00100000:3.0:1788574252.845569:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697664 00000100:00100000:3.0:1788574252.845603:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697792 00000100:00100000:3.0:1788574252.845606:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697792 00000100:00100000:3.0:1788574252.845628:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:3.0:1788574252.845635:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727697664:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574252.845681:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727697664:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 46us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574252.845688:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:3.0:1788574252.845708:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:3.0:1788574252.845715:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727697792:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574252.845740:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727697792:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574252.845747:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:0.0:1788574252.846215:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2356:x1875455727697920:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 904us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574252.846224:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 156 00000100:00100000:0.0:1788574252.846246:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00100000:0.0:1788574252.846255:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2356:x1875455727697536:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574252.846285:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2356:x1875455727697536:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 33us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574252.846291:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00080000:0.0:1788574252.846321:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574252.846326:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574252.846328:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574252.847556:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727697408 00000100:00100000:1.0:1788574252.847576:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727697408 00000100:00100000:1.0:1788574252.847649:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 298 00000100:00100000:1.0:1788574252.847661:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727697408:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574252.847740:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727697408:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 81us (2760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.847747:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 298 00000100:00100000:3.0:1788574253.222849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.224720:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727698048 00000100:00100000:0.0:1788574253.224746:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727698048 00000100:00100000:0.0:1788574253.226926:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 139 00000100:00100000:0.0:1788574253.226945:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:11329:x1875455727698048:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574253.226967:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574253.226990:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53624f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3988 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.227067:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.227084:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.227099:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.227130:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.227139:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.227145:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228495:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228512:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228520:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228526:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574253.228532:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228539:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228554:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:0.0:1788574253.228558:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574253.228562:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228569:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228590:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228595:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228600:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228605:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574253.228608:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228614:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228621:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a78544f200) 00010000:00010000:0.0:1788574253.228623:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574253.228626:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.228631:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53625d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.230219:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53624f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3988 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.230238:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:0.0:1788574253.230241:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574253.230266:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53624f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3988 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.230279:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ce00, rc 0) 00000100:00100000:0.0:1788574253.230363:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:11329:x1875455727698048:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 3423us (7525us total) trans 0 rc 301/301 00000100:00100000:0.0:1788574253.230387:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 139 00000100:00080000:0.0:1788574253.230426:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574253.253076:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574253.253123:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727698304 00000100:00100000:1.0:1788574253.253148:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727698304 00000100:00100000:1.0:1788574253.253208:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 140 00000100:00100000:1.0:1788574253.253219:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:11329:x1875455727698304:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:1.0:1788574253.254896:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574253.254933:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b535bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37c1 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.254955:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:1.0:1788574253.254960:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574253.255202:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.255217:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 5 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.255226:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.255278:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 5 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.255294:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 5 pid: 10109 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.255589:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747630208:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574253.255692:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574253.268353:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747630208:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574253.268628:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.268669:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727698432 00000100:00100000:0.0:1788574253.268679:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727698432 00010000:00010000:0.0:1788574253.268729:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 6 pid: 10109 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574253.268782:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:0.0:1788574253.268793:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2356:x1875455727698432:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574253.268809:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574253.268817:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 6 pid: 10109 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.268831:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 6 pid: 10109 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.268853:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce397a expref: 6 pid: 10109 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.268904:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:0.0:1788574253.268910:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.268928:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.268935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.268953:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574253.269900:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.269917:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.269924:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.269951:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.269962:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.269971:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574253.271031:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727698432:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 2229us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574253.271045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000004:00200000:1.0:1788574253.274620:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788574253.274644:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.274654:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.275529:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.275543:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574253.275548:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.275557:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.275574:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a78544fd00) 00010000:00010000:1.0:1788574253.275576:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574253.275581:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.275589:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536264 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574253.275612:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cd98dcf reply state 000000002141df16 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.275622:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574253.276430:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:11329:x1875455727698304:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 23204us (23357us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788574253.276443:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 140 00010000:00010000:3.0:1788574253.300054:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.300080:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.300088:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.300109:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574253.300115:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.300125:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.300154:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a7b2398e00) 00010000:00010000:3.0:1788574253.300157:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574253.300163:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.300170:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b53626b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574253.376075:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788574253.378963:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574253.419717:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.419887:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727698560 00000100:00100000:2.0:1788574253.419912:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727698560 00000100:00100000:2.0:1788574253.419972:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 141 00000100:00100000:2.0:1788574253.419984:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:11338:x1875455727698560:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:2.0:1788574253.420015:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574253.420046:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce398f expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.420113:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.420127:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.420139:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574253.420180:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788574253.420185:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574253.420207:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.420232:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce398f expref: 15 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.420249:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce398f expref: 14 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.420258:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:2.0:1788574253.420260:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574253.420264:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984000, rc 0) 00000100:00100000:2.0:1788574253.420339:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:11338:x1875455727698560:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 347us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574253.420346:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 141 00000100:00100000:3.0:1788574253.494875:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.494987:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727698688 00000100:00100000:0.0:1788574253.494998:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727698688 00000100:00100000:0.0:1788574253.495061:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 142 00000100:00100000:0.0:1788574253.495071:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:11344:x1875455727698688:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574253.495093:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574253.495117:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3996 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495197:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495213:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495226:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495260:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495267:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495273:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495363:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495418:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495425:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574253.495459:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788574253.495464:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574253.495490:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495503:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495509:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495516:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495533:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574253.495538:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495544:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495556:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:0.0:1788574253.495559:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574253.495565:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495572:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495586:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495592:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495598:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495602:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574253.495604:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495610:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495627:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a78544f200) 00010000:00010000:0.0:1788574253.495629:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574253.495632:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495637:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53628e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495669:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3996 expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495682:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3996 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.495689:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574253.495691:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574253.495693:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d800, rc 0) 00000100:00100000:0.0:1788574253.495765:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:11344:x1875455727698688:12345-192.168.201.57@tcp:101:bash.0 Request processed in 693us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574253.495772:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 142 00000100:00100000:1.0:1788574253.505190:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.505311:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727698944 00000100:00100000:2.0:1788574253.505322:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727698944 00000100:00100000:2.0:1788574253.505445:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 143 00000100:00100000:2.0:1788574253.505457:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+15:11344:x1875455727698944:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574253.505484:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574253.505511:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53629c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce399d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.505671:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.505687:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.505699:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.505771:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.505779:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.505787:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574253.506510:0:5859:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788574253.506712:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506731:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506740:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506779:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506786:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506794:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506800:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574253.506804:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506812:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506823:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574253.506827:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574253.506832:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506838:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574253.506851:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009555c6e5 reply state 000000003ac64593 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574253.506877:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788574253.506911:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53629c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506927:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 17 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.506933:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:2.0:1788574253.506936:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574253.506938:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574253.507017:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11344:x1875455727698944:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1563us (1842us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788574253.507026:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 143 00010000:00010000:3.0:1788574253.511911:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.511929:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.511937:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.511943:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574253.511948:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.511956:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.511987:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a782d70c00) 00010000:00010000:3.0:1788574253.511990:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574253.511995:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.512001:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5362aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.514596:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.514727:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727699072 00000100:00100000:0.0:1788574253.514749:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727699072 00000100:00100000:0.0:1788574253.514825:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:0.0:1788574253.514838:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727699072:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574253.514860:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574253.514903:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39a4 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574253.514958:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574253.514980:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1788574253.514985:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574253.514996:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 6 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.515020:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 6 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.515036:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574253.515105:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727699072:12345-192.168.201.57@tcp:101:bash.0 Request processed in 270us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574253.515112:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788574253.519420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.519618:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727699200 00000100:00100000:3.0:1788574253.519628:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727699200 00000100:00100000:3.0:1788574253.519695:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:3.0:1788574253.519706:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:11344:x1875455727699200:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574253.519724:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574253.519757:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39ab expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.519792:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.519802:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574253.519806:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574253.519813:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.519848:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.519896:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 7 pid: 6711 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574253.519910:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e6ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10306:1875455747630336:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574253.520009:0:10306:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a781377a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574253.522999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574253.523425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727699328 00000100:00100000:1.0:1788574253.523435:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727699328 00010000:00010000:1.0:1788574253.523475:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 8 pid: 6711 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.523536:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:1.0:1788574253.523546:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727699328:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574253.523561:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574253.523586:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 8 pid: 6711 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.523602:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 8 pid: 6711 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.523628:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574253.523632:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574253.523641:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.523651:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.523687:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.523702:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5843:1875455747630464:192.168.201.57@tcp:105: 00000100:00100000:1.0:1788574253.523797:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8600 going to sleep for 11 seconds 00010000:00010000:3.0:1788574253.524739:0:10306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b5362bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39a4 expref: 8 pid: 6711 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574253.524762:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e6ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10306:1875455747630336:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574253.524790:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 7 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.524804:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574253.525105:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:11344:x1875455727699200:12345-192.168.201.57@tcp:101:bash.0 Request processed in 5161us (5506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574253.525115:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:0.0:1788574253.531769:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.532026:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727699584 00000100:00100000:3.0:1788574253.532036:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727699584 00000100:00100000:3.0:1788574253.532094:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:3.0:1788574253.532105:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:11344:x1875455727699584:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788574253.532513:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11344:x1875455727699584:12345-192.168.201.57@tcp:35:bash.0 Request processed in 407us (755us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788574253.532521:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:1.0:1788574253.533249:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5843:1875455747630464:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788574253.533281:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574253.533309:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727699328:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 9765us (10322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574253.533318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:3.0:1788574253.632301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.632645:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727699840 00000100:00100000:0.0:1788574253.632656:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727699840 00000100:00100000:0.0:1788574253.632833:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 144 00000100:00100000:0.0:1788574253.632845:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11354:x1875455727699840:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574253.632882:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574253.632905:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39b2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574253.633002:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788574253.633128:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39b2 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.633163:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:0.0:1788574253.633166:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574253.633172:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39b2 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.633188:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ce00, rc 0) 00000100:00100000:0.0:1788574253.633309:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:11354:x1875455727699840:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 466us (1014us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788574253.633317:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 144 00000100:00100000:3.0:1788574253.636545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.636589:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727700096 00000100:00100000:3.0:1788574253.636600:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727700096 00000100:00100000:3.0:1788574253.636669:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:3.0:1788574253.636681:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:11354:x1875455727700096:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574253.637560:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11354:x1875455727700096:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 873us (1019us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788574253.637572:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788574253.746531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.746660:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727700224 00000100:00100000:0.0:1788574253.746672:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727700224 00000100:00100000:0.0:1788574253.746737:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 145 00000100:00100000:0.0:1788574253.746747:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11360:x1875455727700224:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574253.746775:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574253.746801:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39b9 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.746886:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5362e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.746904:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5362e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.746926:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5362e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574253.746968:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788574253.746988:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574253.747008:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5362e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.747035:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39b9 expref: 22 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.747055:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5362e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39b9 expref: 21 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.747064:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574253.747067:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574253.747071:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c800, rc 0) 00000100:00100000:0.0:1788574253.747132:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:11360:x1875455727700224:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 386us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574253.747139:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 145 00000100:00100000:0.0:1788574253.752317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.753245:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727700480 00000100:00100000:2.0:1788574253.753258:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727700480 00000100:00100000:2.0:1788574253.753399:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 146 00000100:00100000:2.0:1788574253.753411:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:11360:x1875455727700480:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574253.753432:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574253.753452:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5362e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39c0 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.753554:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.753569:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.753596:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574253.753609:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788574253.753769:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5362e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c0 expref: 24 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.753789:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c0 expref: 23 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.753798:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:2.0:1788574253.753801:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574253.753804:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984a00, rc 0) 00000100:00100000:2.0:1788574253.753888:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:11360:x1875455727700480:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 479us (1580us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788574253.753896:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 146 00000100:00100000:3.0:1788574253.760263:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.762815:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.762873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727700864 00000100:00100000:3.0:1788574253.762887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727700864 00000100:00100000:3.0:1788574253.762973:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574253.762985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:2356:x1875455727700864:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574253.763001:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574253.763029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5362f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c0 expref: 23 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.763050:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:3.0:1788574253.763056:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574253.763120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2356:x1875455727700864:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 137us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574253.763128:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788574253.765179:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727700736 00000100:00100000:0.0:1788574253.765196:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727700736 00000100:00100000:0.0:1788574253.765279:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 147 00000100:00100000:0.0:1788574253.765290:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:11360:x1875455727700736:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574253.765318:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574253.765344:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39c7 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.765491:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.765509:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.765537:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574253.765550:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788574253.765693:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5362fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c7 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.765711:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c7 expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.765718:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:0.0:1788574253.765720:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788574253.765723:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c000, rc 0) 00000100:00100000:0.0:1788574253.766149:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:11360:x1875455727700736:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 861us (5898us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788574253.766157:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 147 00000100:00100000:3.0:1788574253.771515:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574253.771669:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727700992 00000100:00100000:0.0:1788574253.771680:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727700992 00000100:00100000:0.0:1788574253.771748:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:0.0:1788574253.771757:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2354:x1875455727700992:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:0.0:1788574253.771797:0:12090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.771815:0:12090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 6 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.771823:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574253.771840:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574253.771845:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.771895:0:12090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 6 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.771920:0:12090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 6 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574253.771938:0:12090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12090:1875455747630592:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574253.772069:0:12090:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574253.777258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.777349:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727701120 00000100:00100000:2.0:1788574253.777358:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727701120 00002000:00100000:2.0:1788574253.777457:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90a7bbebca80 x1875455727701120/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:404/0 lens 504/0 e 0 to 0 dl 1788574264 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574253.777467:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bbebca80 with x1875455727701120 ext(0->12) 00010000:00010000:2.0:1788574253.777477:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 7 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.777491:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 7 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574253.777514:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a7bbebca80 00000100:00100000:2.0:1788574253.777550:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574253.777559:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727701120:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:2.0:1788574253.778139:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727701120:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 577us (888us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788574253.778148:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00002000:00100000:2.0:1788574253.778157:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90a7bbebca80 x1875455727701120/t4294967305(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:404/0 lens 504/448 e 0 to 0 dl 1788574264 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574253.778165:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bbebca80 with x1875455727701120 ext(0->12) 00010000:00010000:2.0:1788574253.778172:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 9 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.778185:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 9 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574253.778191:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a7bbebca80 00000100:00100000:0.0:1788574253.779265:0:12090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12090:1875455747630592:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574253.779296:0:12090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574253.782501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574253.782598:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727701248 00000100:00100000:1.0:1788574253.782609:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727701248 00010000:00010000:1.0:1788574253.782658:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 9 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.782698:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788574253.782709:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727701248:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574253.782737:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788574253.782759:0:5843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788574253.782762:0:5843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788574253 00002000:00010000:1.0:1788574253.782764:0:5843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788574254 00002000:00010000:1.0:1788574253.782767:0:5843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788574253 00010000:00010000:1.0:1788574253.782773:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 9 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.782787:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 9 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.782807:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018845f14/0x10531a153b5362c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ab expref: 9 pid: 10306 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.782843:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574253.782847:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574253.782853:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.782874:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.782915:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574253.782979:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727701248:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 272us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574253.782987:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00010000:00010000:0.0:1788574253.783250:0:12090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783261:0:12090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783287:0:12090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783308:0:12090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783316:0:12090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783322:0:12090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574253.783326:0:12090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783336:0:12090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783347:0:12090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574253.783354:0:12090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536313 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574253.783446:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727700992:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 11689us (11941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574253.783455:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:0.0:1788574253.788943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.789133:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727701504 00000100:00100000:2.0:1788574253.789144:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727701504 00000100:00100000:2.0:1788574253.789206:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:2.0:1788574253.789216:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785621050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:11360:x1875455727701504:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:2.0:1788574253.789286:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c7 expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574253.789655:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788574253.789707:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788574253.791275:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788574253.791884:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.792040:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.792051:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.792091:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.792108:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 28 pid: 5859 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574253.792123:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1875455747630720:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574253.792222:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574253.796116:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1875455747630720:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574253.796166:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574253.798436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.799074:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727701632 00000100:00100000:3.0:1788574253.799108:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727701632 00010000:00010000:3.0:1788574253.799168:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 29 pid: 5859 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574253.799218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:3.0:1788574253.799230:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:2356:x1875455727701632:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574253.799250:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574253.799257:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 29 pid: 5859 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.799270:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 29 pid: 5859 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.799295:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5362b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce399d expref: 29 pid: 5859 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.799314:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:3.0:1788574253.799320:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.799532:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.799540:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.799574:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574253.799640:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:2356:x1875455727701632:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 411us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574253.799657:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00010000:00010000:1.0:1788574253.799847:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.799856:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574253.800004:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788574253.800206:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788574253.800317:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747630848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788574253.800412:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574253.800453:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574253.801152:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747630848 00000100:00100000:3.0:1788574253.801163:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747630848 00000100:00100000:3.0:1788574253.801237:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574253.801247:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875455747630848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574253.801355:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875455747630848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574253.801363:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788574253.803034:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574253.803097:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747630848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788574253.804197:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788574253.804300:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747630976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788574253.804362:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574253.805076:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574253.805250:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747630976 00000100:00100000:3.0:1788574253.805258:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747630976 00000100:00100000:3.0:1788574253.805581:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574253.805593:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875455747630976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574253.805902:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1875455747630976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 312us (1539us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788574253.806015:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1875455747630976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788574253.806082:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788574253.806124:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.806135:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.806143:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.806149:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574253.806153:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.806161:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.806177:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:1.0:1788574253.806180:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788574253.806185:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.806191:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53631a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574253.806401:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788574253.806505:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788574253.806526:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379981157736ns, next at 380981156015ns, rc = 0 00000001:00080000:1.0:1788574253.806533:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788574253.806563:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70f00) 00010000:00010000:1.0:1788574253.806565:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788574253.806572:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39c7 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.806747:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785621050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:11360:x1875455727701504:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 17532us (17814us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788574253.806758:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000020:00080000:1.0:1788574253.806764:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788574253.807117:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574253.811116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.811500:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727701760 00000100:00100000:2.0:1788574253.811513:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727701760 00000100:00100000:2.0:1788574253.811571:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 148 00000100:00100000:2.0:1788574253.811582:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:11360:x1875455727701760:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574253.811613:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574253.811637:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39ce expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.811784:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ce expref: 32 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.811799:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ce expref: 32 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.811819:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:2.0:1788574253.811822:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574253.811826:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574253.811900:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11360:x1875455727701760:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 319us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574253.812017:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 148 00000100:00100000:2.0:1788574253.816004:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.816157:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727702016 00000100:00100000:3.0:1788574253.816167:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727702016 00000100:00100000:3.0:1788574253.816225:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788574253.816235:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11360:x1875455727702016:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574253.816516:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+33:11360:x1875455727702016:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 281us (522us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788574253.816524:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:0.0:1788574253.931045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574253.931105:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727702272 00000100:00100000:2.0:1788574253.931118:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727702272 00000100:00100000:2.0:1788574253.931186:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 149 00000100:00100000:2.0:1788574253.931205:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+33:11370:x1875455727702272:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574253.931232:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574253.931252:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39d5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574253.931362:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788574253.931538:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536328 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39d5 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.931569:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:2.0:1788574253.931573:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574253.931579:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39d5 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574253.931594:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984600, rc 0) 00000100:00100000:2.0:1788574253.931679:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11370:x1875455727702272:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 476us (647us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788574253.931686:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 149 00000100:00100000:0.0:1788574253.939169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574253.939358:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727702400 00000100:00100000:1.0:1788574253.939601:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727702400 00000100:00100000:1.0:1788574253.939670:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 150 00000100:00100000:1.0:1788574253.939683:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11370:x1875455727702400:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:1.0:1788574253.939786:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.939805:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.939821:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.939839:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.939846:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.939853:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940255:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940265:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940272:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574253.940312:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940324:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940734:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940742:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940748:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574253.940752:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940761:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940772:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574253.940775:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574253.940780:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940795:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940811:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940817:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940822:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940827:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574253.940830:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940836:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940844:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a7b2398400) 00010000:00010000:1.0:1788574253.940847:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574253.940850:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.940866:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b53633d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941116:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941124:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941136:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941140:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574253.941143:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941150:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941157:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574253.941160:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574253.941163:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574253.941168:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574253.941262:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11370:x1875455727702400:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1576us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574253.941271:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 150 00000100:00100000:1.0:1788574253.945202:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.945301:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727702656 00000100:00100000:3.0:1788574253.945310:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727702656 00000100:00100000:3.0:1788574253.945615:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:3.0:1788574253.945626:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11370:x1875455727702656:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574253.946251:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:11370:x1875455727702656:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 624us (1055us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788574253.946261:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:0.0:1788574253.998782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574253.998911:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727702912 00000100:00100000:3.0:1788574253.998923:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727702912 00000100:00100000:3.0:1788574253.998989:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 151 00000100:00100000:3.0:1788574253.999002:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:11373:x1875455727702912:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574253.999030:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574253.999056:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53634b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39dc expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999142:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999157:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999172:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999189:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999196:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999202:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999319:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999340:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999349:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574253.999359:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788574253.999512:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999520:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999528:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999534:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574253.999538:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999545:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999556:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574253.999559:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574253.999564:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999570:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999583:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999595:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999601:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999606:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574253.999609:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999615:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999622:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a784e37100) 00010000:00010000:3.0:1788574253.999625:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574253.999627:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999633:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999673:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b53634b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 38 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999687:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 37 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574253.999693:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574253.999696:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574253.999705:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7c00, rc 0) 00000100:00100000:3.0:1788574253.999768:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11373:x1875455727702912:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 769us (997us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788574253.999776:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 151 00000100:00100000:0.0:1788574254.007782:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574254.008199:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727703040 00000100:00100000:2.0:1788574254.008210:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727703040 00000100:00100000:2.0:1788574254.008277:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 152 00000100:00100000:2.0:1788574254.008289:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11373:x1875455727703040:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:2.0:1788574254.008358:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008423:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008435:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008463:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008470:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008494:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008500:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574254.008505:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008513:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008526:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:2.0:1788574254.008529:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574254.008534:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.008540:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b53636e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574254.008616:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11373:x1875455727703040:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 328us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574254.008624:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 152 00000100:00100000:1.0:1788574254.012698:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574254.012898:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727703296 00000100:00100000:2.0:1788574254.012917:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727703296 00000100:00100000:2.0:1788574254.012973:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:2.0:1788574254.012983:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11373:x1875455727703296:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574254.013225:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:11373:x1875455727703296:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 242us (544us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788574254.013233:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:3.0:1788574254.208742:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747631232:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.208822:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574254.208902:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747631744:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.208929:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574254.208960:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574254.208967:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747631360:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.208997:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574254.209033:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747631744 00000100:00100000:3.0:1788574254.209041:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747631744 00000100:00100000:1.0:1788574254.209067:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747631104:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.209107:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574254.209113:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574254.209122:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747631744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574254.209147:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747631616:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.209187:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747631744:12345-0@lo:400:kworker.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574254.209188:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574254.209199:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574254.209215:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574254.209238:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a77a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747631488:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.209251:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747631744:0@lo:400:kworker.0 00000100:00100000:1.0:1788574254.209268:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574254.209278:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747631232 00000100:00100000:3.0:1788574254.209282:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747631232 00000100:00100000:1.0:1788574254.209313:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747631104 00000100:00100000:3.0:1788574254.209316:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747631360 00000100:00100000:1.0:1788574254.209319:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747631104 00000100:00100000:3.0:1788574254.209321:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747631360 00000100:00100000:1.0:1788574254.209356:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788574254.209357:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747631616 00000100:00100000:3.0:1788574254.209362:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747631616 00000100:00100000:3.0:1788574254.209413:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574254.209421:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574254.209454:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747631488 00000100:00100000:3.0:1788574254.209471:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747631232:12345-0@lo:400:kworker.0 Request processed in 51us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574254.209478:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574254.209492:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574254.209499:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747631360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.209525:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747631360:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574254.209530:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574254.209538:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788574254.209544:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747631616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.209577:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747631616:12345-0@lo:400:kworker.0 Request processed in 33us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574254.209582:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788574254.209601:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747631488 00000100:00100000:3.0:1788574254.209608:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747631360:0@lo:400:kworker.0 00000100:00100000:3.0:1788574254.209622:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747631232:0@lo:400:kworker.0 00000100:00100000:2.0:1788574254.209641:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788574254.209689:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574254.209695:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574254.209730:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747631488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574254.209771:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747631488:12345-0@lo:400:kworker.0 Request processed in 122us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574254.209779:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788574254.209808:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747631488:0@lo:400:kworker.0 00000100:00100000:0.0:1788574254.209821:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747631616:0@lo:400:kworker.0 00000100:00100000:1.0:1788574254.210624:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574254.210707:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747631104:12345-0@lo:400:kworker.0 Request processed in 1341us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574254.210715:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788574254.210913:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a77a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747631104:0@lo:400:kworker.0 00000100:00100000:0.0:1788574254.391325:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574254.391534:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727703552 00000100:00100000:3.0:1788574254.391547:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727703552 00000100:00100000:3.0:1788574254.391632:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 153 00000100:00100000:3.0:1788574254.391652:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:11404:x1875455727703552:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788574254.391687:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574254.391727:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536375 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39e3 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.391970:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53637c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.391990:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53637c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.392003:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53637c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574254.392017:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788574254.392176:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536375 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39e3 expref: 41 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.392198:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53637c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39e3 expref: 40 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.392208:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574254.392211:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574254.392214:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574254.392299:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11404:x1875455727703552:12345-192.168.201.57@tcp:101:cat.0 Request processed in 649us (985us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788574254.392306:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 153 00000100:00100000:0.0:1788574254.404246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574254.404298:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574254.404406:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727703808 00000100:00100000:2.0:1788574254.404419:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727703808 00000100:00100000:2.0:1788574254.404499:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:2.0:1788574254.404524:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11404:x1875455727703808:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:2.0:1788574254.405365:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:11404:x1875455727703808:12345-192.168.201.57@tcp:35:cat.0 Request processed in 836us (1122us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788574254.405407:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788574254.406962:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727703936 00000100:00100000:3.0:1788574254.406986:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727703936 00000100:00100000:3.0:1788574254.407069:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574254.407081:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:2356:x1875455727703936:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574254.407096:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574254.407137:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53637c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39e3 expref: 41 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.407171:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574254.407179:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574254.407236:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:2356:x1875455727703936:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 158us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574254.407243:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00010000:00010000:1.0:1788574254.409327:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574254.545556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574254.545634:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727704192 00000100:00100000:3.0:1788574254.545645:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727704192 00000100:00100000:3.0:1788574254.545714:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 154 00000100:00100000:3.0:1788574254.545726:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11410:x1875455727704192:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:3.0:1788574254.545751:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574254.545755:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574254.545792:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5362e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39b9 expref: 40 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.546132:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574254.546227:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574254.546246:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53638a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39ea expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.546354:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.546446:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 40 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.546478:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.546514:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 40 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.546533:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 40 pid: 11654 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574254.546554:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747631872:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574254.546686:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574254.552412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574254.552614:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727704320 00000100:00100000:1.0:1788574254.552629:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727704320 00010000:00010000:1.0:1788574254.552686:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 41 pid: 11654 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574254.552729:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:1.0:1788574254.552739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b104450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:2356:x1875455727704320:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574254.552755:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574254.552762:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 41 pid: 11654 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.552786:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 41 pid: 11654 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.552837:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574254.552856:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.553225:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.553233:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.553256:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574254.553315:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b104450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:2356:x1875455727704320:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 577us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574254.553324:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00010000:00010000:3.0:1788574254.553744:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b536360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39dc expref: 40 pid: 11654 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574254.553764:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747631872:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574254.553797:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.553810:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.553986:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574254.554007:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788574254.554189:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b53638a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 41 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.554221:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 40 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.554229:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574254.554232:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574254.554235:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7400, rc 0) 00000100:00100000:3.0:1788574254.554290:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11410:x1875455727704192:12345-192.168.201.57@tcp:101:dd.0 Request processed in 8566us (8745us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788574254.554298:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 154 00000100:00100000:0.0:1788574254.557806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574254.557999:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727704576 00000100:00100000:1.0:1788574254.558011:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727704576 00000100:00100000:1.0:1788574254.558070:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 155 00000100:00100000:1.0:1788574254.558080:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11410:x1875455727704576:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:1.0:1788574254.558670:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.558689:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574254.558700:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574254.558754:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788574254.558777:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6688477 reply state 000000006a2c17d9 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574254.558785:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574254.559314:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:11410:x1875455727704576:12345-192.168.201.57@tcp:36:dd.0 Request processed in 1230us (1515us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788574254.559345:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 155 00000020:00080000:1.0:1788574254.559353:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574254.571721:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.571741:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.571750:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.571756:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574254.571762:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.571769:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.571787:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574254.571791:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574254.571796:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.571828:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53639f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574254.720762:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574254.720838:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574254.721081:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747632000 00000100:00100000:2.0:1788574254.721097:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747632000 00000100:00100000:2.0:1788574254.721206:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788574254.721228:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875455747632000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574254.721272:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574254.721325:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875455747632000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574254.721335:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574254.721584:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747632000:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788574254.862449:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788574254.862497:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1788574254.919978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574254.920053:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727704704 00000100:00100000:2.0:1788574254.920065:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727704704 00000100:00100000:2.0:1788574254.920134:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 156 00000100:00100000:2.0:1788574254.920146:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:11424:x1875455727704704:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:2.0:1788574254.920194:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574254.920219:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39f1 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.920288:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.920303:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.920316:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.920332:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.920340:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.920346:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.920498:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.920510:0:10109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 43 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.920519:0:10109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.920560:0:10109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 43 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.920576:0:10109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 43 pid: 5859 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574254.920592:0:10109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747632128:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574254.920703:0:10109:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574254.928094:0:10109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747632128:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574254.928128:0:10109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574254.929853:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574254.931038:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727704960 00000100:00100000:2.0:1788574254.931052:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727704960 00000100:00100000:2.0:1788574254.931115:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:2.0:1788574254.931137:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+44:5593:x1875455727704960:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788574254.931809:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:5593:x1875455727704960:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 678us (1969us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788574254.931819:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788574254.934192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574254.938622:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727705088 00000100:00100000:2.0:1788574254.938666:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727705088 00010000:00010000:2.0:1788574254.938733:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 45 pid: 5859 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574254.938879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:2.0:1788574254.938892:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:2356:x1875455727705088:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574254.938914:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574254.938922:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 45 pid: 5859 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.938936:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 45 pid: 5859 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.938963:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ea expref: 45 pid: 5859 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.938984:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:2.0:1788574254.938989:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.939000:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.939008:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574254.939046:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574254.939120:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+44:2356:x1875455727705088:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 230us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574254.939149:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00010000:00010000:3.0:1788574254.939222:0:10109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939231:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574254.939284:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788574254.939289:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574254.939311:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939322:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939331:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939336:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939342:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939345:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574254.939349:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939355:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939362:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574254.939385:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574254.939389:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939393:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5363ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939402:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939405:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939409:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939412:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574254.939413:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939417:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939421:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a782d70100) 00010000:00010000:3.0:1788574254.939422:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574254.939424:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939427:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5363b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939462:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f1 expref: 44 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939482:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f1 expref: 43 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574254.939489:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574254.939491:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574254.939493:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574254.939531:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:11424:x1875455727704704:12345-192.168.201.57@tcp:101:stat.0 Request processed in 19388us (19567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574254.939539:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 156 00000100:00100000:1.0:1788574255.049541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574255.049689:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727705344 00000100:00100000:3.0:1788574255.049699:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727705344 00000100:00100000:3.0:1788574255.049772:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00100000:3.0:1788574255.049780:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:11430:x1875455727705344:12345-192.168.201.57@tcp:36:truncate.0 00010000:00010000:3.0:1788574255.049850:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574255.049881:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5363bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f1 expref: 43 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.049903:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574255.049909:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574255.050206:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.050220:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.050229:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574255.050294:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788574255.050316:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2ae923 reply state 00000000e064c56f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574255.050324:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574255.050467:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:11430:x1875455727705344:12345-192.168.201.57@tcp:36:truncate.0 Request processed in 685us (938us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788574255.050474:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 157 00000020:00080000:3.0:1788574255.050478:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788574255.050908:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574255.061959:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.061981:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.061990:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.061997:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574255.062003:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.062011:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.062032:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574255.062035:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574255.062040:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.062047:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574255.307113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574255.307261:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727705472 00000100:00100000:0.0:1788574255.307275:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727705472 00000100:00100000:0.0:1788574255.307404:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 158 00000100:00100000:0.0:1788574255.307418:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+44:11444:x1875455727705472:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:0.0:1788574255.307446:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574255.307473:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5363c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307550:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307565:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307599:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307617:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307625:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307631:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307743:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307751:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307757:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574255.307794:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788574255.307798:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574255.307823:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.307845:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308183:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308205:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308212:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308217:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574255.308222:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308229:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308242:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574255.308245:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574255.308250:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308257:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5363d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308272:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308278:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308284:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308288:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574255.308298:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308304:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308311:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a78544fe00) 00010000:00010000:0.0:1788574255.308313:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574255.308315:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308320:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5363d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308354:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5363c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308972:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 45 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.308981:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:0.0:1788574255.308984:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574255.308987:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c800, rc 0) 00000100:00100000:0.0:1788574255.309111:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:11444:x1875455727705472:12345-192.168.201.57@tcp:101:stat.0 Request processed in 1693us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574255.309123:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 158 00010000:00010000:0.0:1788574255.424489:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574255.426986:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574255.427448:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727705728 00000100:00100000:3.0:1788574255.427468:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727705728 00000100:00100000:3.0:1788574255.427615:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 159 00000100:00100000:3.0:1788574255.427635:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+45:11454:x1875455727705728:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574255.427674:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574255.427714:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce39ff expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574255.427866:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788574255.427994:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ff expref: 47 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.428010:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:3.0:1788574255.428013:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574255.428019:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5363e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ff expref: 47 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.428034:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7c00, rc 0) 00000100:00100000:3.0:1788574255.428114:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:11454:x1875455727705728:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 486us (1147us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788574255.428125:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 159 00000100:00100000:3.0:1788574255.433797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574255.433897:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727705984 00000100:00100000:2.0:1788574255.433908:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727705984 00000100:00100000:2.0:1788574255.433975:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:2.0:1788574255.433988:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7861dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+46:11454:x1875455727705984:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574255.434347:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7861dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:11454:x1875455727705984:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 337us (537us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788574255.434413:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:0.0:1788574255.547807:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574255.547941:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727706240 00000100:00100000:2.0:1788574255.547957:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727706240 00000100:00100000:2.0:1788574255.548014:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 160 00000100:00100000:2.0:1788574255.548024:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+47:11460:x1875455727706240:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574255.548048:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574255.548069:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5363f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a06 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.548167:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.548183:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.548192:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.548225:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.548258:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 48 pid: 5858 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574255.548272:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747632256:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574255.548441:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574255.559914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574255.560007:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727706368 00000100:00100000:0.0:1788574255.560030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727706368 00010000:00010000:0.0:1788574255.560071:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 49 pid: 5858 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574255.560111:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:0.0:1788574255.560121:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:2355:x1875455727706368:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574255.560135:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574255.560142:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 49 pid: 5858 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.560154:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 49 pid: 5858 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.560176:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:0.0:1788574255.560182:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.560191:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.560199:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.560218:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574255.560280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+49:2355:x1875455727706368:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574255.561860:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00010000:00010000:2.0:1788574255.562511:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5363de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39f8 expref: 48 pid: 5858 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574255.562536:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747632256:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574255.562562:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.562574:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.562580:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574255.562602:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788574255.563606:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5363f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 49 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.563630:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 48 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.563640:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:2.0:1788574255.563657:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574255.563661:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984600, rc 0) 00000100:00100000:2.0:1788574255.563904:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:11460:x1875455727706240:12345-192.168.201.57@tcp:101:bash.0 Request processed in 15879us (16104us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788574255.563913:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 160 00000100:00100000:3.0:1788574255.572997:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574255.573097:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727706624 00000100:00100000:0.0:1788574255.573112:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727706624 00000100:00100000:0.0:1788574255.573185:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00100000:0.0:1788574255.573196:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:11460:x1875455727706624:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:0.0:1788574255.573494:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.573513:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574255.573525:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574255.573590:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788574255.573628:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008f64f03 reply state 000000004708335e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574255.573640:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574255.576419:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:11460:x1875455727706624:12345-192.168.201.57@tcp:36:bash.0 Request processed in 3213us (3428us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788574255.576431:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 161 00000020:00080000:0.0:1788574255.576439:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574255.582666:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.582686:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.582723:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.582730:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574255.582735:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.582743:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.582763:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574255.582766:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574255.582772:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.582778:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b536408 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574255.586656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.586850:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727706752 00000100:00100000:1.0:1788574255.586861:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727706752 00000100:00100000:1.0:1788574255.586949:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 162 00000100:00100000:1.0:1788574255.586960:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:11460:x1875455727706752:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788574255.586986:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574255.587008:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53640f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a0d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.587090:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.587105:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 51 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.587114:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.587225:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 51 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.587259:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 51 pid: 11654 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574255.587275:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747632384:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574255.587702:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c94d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574255.594993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574255.595925:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727706880 00000100:00100000:3.0:1788574255.595939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727706880 00010000:00010000:3.0:1788574255.595985:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 52 pid: 11654 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574255.596035:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:3.0:1788574255.596046:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:2356:x1875455727706880:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574255.596060:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574255.596067:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 52 pid: 11654 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.596098:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 52 pid: 11654 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.596134:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574255.596141:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.596151:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.596160:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.596180:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574255.596247:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:2356:x1875455727706880:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 202us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574255.596254:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 66 00010000:00010000:1.0:1788574255.600334:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5363fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a06 expref: 51 pid: 11654 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574255.600385:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1875455747632384:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574255.600415:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.600426:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.600433:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574255.600484:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788574255.600489:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574255.600511:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.600545:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53640f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a0d expref: 51 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.600561:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a0d expref: 50 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.600589:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574255.600593:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574255.600597:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20200, rc 0) 00000100:00100000:1.0:1788574255.600674:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:11460:x1875455727706752:12345-192.168.201.57@tcp:101:bash.0 Request processed in 13715us (14028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574255.600683:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 162 00000100:00100000:3.0:1788574255.604563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.604965:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727707136 00000100:00100000:1.0:1788574255.604977:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727707136 00000100:00100000:1.0:1788574255.605039:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:1.0:1788574255.605052:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:11460:x1875455727707136:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:1.0:1788574255.605662:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:11460:x1875455727707136:12345-192.168.201.57@tcp:35:bash.0 Request processed in 610us (1106us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788574255.605672:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:0.0:1788574255.757087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574255.757489:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727707392 00000100:00100000:2.0:1788574255.757499:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727707392 00000100:00100000:2.0:1788574255.757566:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 163 00000100:00100000:2.0:1788574255.757578:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:11470:x1875455727707392:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574255.757606:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574255.757630:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53641d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a14 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574255.757846:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788574255.757971:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53641d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a14 expref: 53 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.757986:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:2.0:1788574255.757989:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574255.757995:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b53641d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a14 expref: 53 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574255.758010:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574255.758126:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11470:x1875455727707392:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 542us (1041us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788574255.758134:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 163 00000100:00100000:0.0:1788574255.769312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.769528:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727707520 00000100:00100000:1.0:1788574255.769539:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727707520 00000100:00100000:1.0:1788574255.769602:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 164 00000100:00100000:1.0:1788574255.769613:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11470:x1875455727707520:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:1.0:1788574255.769700:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769717:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769729:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769763:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769770:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769777:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769887:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769897:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769903:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574255.769947:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769961:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769967:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769974:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.769980:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574255.769985:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770000:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770013:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574255.770016:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574255.770021:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770028:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53642b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770042:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770048:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770054:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770060:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574255.770063:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770068:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770074:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a7b2398400) 00010000:00010000:1.0:1788574255.770077:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574255.770080:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770095:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.770112:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.771094:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.771103:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.771108:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574255.771112:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.771129:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.771140:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574255.771142:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574255.771146:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.771152:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574255.771252:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11470:x1875455727707520:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1637us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574255.771260:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 164 00000100:00100000:3.0:1788574255.785780:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.785894:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727707776 00000100:00100000:1.0:1788574255.785904:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727707776 00000100:00100000:1.0:1788574255.785966:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:1.0:1788574255.785978:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11470:x1875455727707776:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788574255.786234:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:11470:x1875455727707776:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 257us (463us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788574255.786241:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:0.0:1788574255.881947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.884640:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727708032 00000100:00100000:1.0:1788574255.884662:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727708032 00000100:00100000:1.0:1788574255.884756:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 165 00000100:00100000:1.0:1788574255.884768:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+53:11473:x1875455727708032:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574255.884795:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574255.884818:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536440 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a1b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.884912:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.884927:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.884942:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.884957:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.884964:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885004:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885140:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885150:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885158:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574255.885167:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788574255.885265:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885273:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885279:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885285:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574255.885289:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885297:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885310:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574255.885313:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574255.885326:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.885346:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886349:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886709:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886716:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886722:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574255.886726:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886733:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886745:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a7b2398400) 00010000:00010000:1.0:1788574255.886747:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574255.886751:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886756:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53644e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886816:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536440 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a1b expref: 56 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886860:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a1b expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.886868:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574255.886871:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574255.886873:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574255.886956:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:11473:x1875455727708032:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 2189us (5017us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788574255.886963:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 165 00000100:00100000:0.0:1788574255.895904:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574255.895958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.896032:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727708288 00000100:00100000:1.0:1788574255.896043:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727708288 00000100:00100000:1.0:1788574255.896124:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574255.896135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:2354:x1875455727708288:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574255.896151:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574255.896176:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a1b expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574255.896197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574255.896202:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574255.896249:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:2354:x1875455727708288:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574255.896257:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788574255.896327:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727708160 00000100:00100000:3.0:1788574255.896341:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727708160 00000100:00100000:3.0:1788574255.896410:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:3.0:1788574255.896418:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11473:x1875455727708160:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788574255.896481:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896495:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896524:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896553:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896559:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896566:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896571:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574255.896575:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896583:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896593:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:3.0:1788574255.896596:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574255.896599:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574255.896605:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574255.896640:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11473:x1875455727708160:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 223us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574255.896646:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:3.0:1788574255.901865:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574255.901946:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727708544 00000100:00100000:1.0:1788574255.901957:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727708544 00000100:00100000:1.0:1788574255.902021:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:1.0:1788574255.902045:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11473:x1875455727708544:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788574255.902292:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:11473:x1875455727708544:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 248us (437us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788574255.902300:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:0.0:1788574256.112262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574256.112524:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727708800 00000100:00100000:1.0:1788574256.112535:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727708800 00000100:00100000:1.0:1788574256.112592:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:1.0:1788574256.112601:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:11491:x1875455727708800:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:1.0:1788574256.112624:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574256.112643:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53646a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a22 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.112745:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536471 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.112759:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.112770:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574256.112782:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788574256.113097:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53646a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a22 expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.113120:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536471 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a22 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.113157:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:1.0:1788574256.113161:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788574256.113165:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21600, rc 0) 00000100:00100000:1.0:1788574256.113334:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11491:x1875455727708800:12345-192.168.201.57@tcp:101:cat.0 Request processed in 727us (1076us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788574256.113342:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:0.0:1788574256.154246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574256.154356:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727708928 00000100:00100000:1.0:1788574256.154400:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727708928 00000100:00100000:1.0:1788574256.154508:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 168 00000100:00100000:1.0:1788574256.154521:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11493:x1875455727708928:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574256.154546:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574256.154569:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53647f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a29 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.154659:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.154674:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.154699:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574256.154740:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788574256.154745:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574256.154762:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.154799:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53647f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a29 expref: 59 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.154851:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a29 expref: 58 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.154860:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574256.154863:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574256.154874:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20800, rc 0) 00000100:00100000:1.0:1788574256.155148:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11493:x1875455727708928:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 629us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574256.155156:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 168 00000100:00100000:0.0:1788574256.170472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574256.170606:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727709312 00000100:00100000:1.0:1788574256.170618:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727709312 00000100:00100000:1.0:1788574256.170681:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:1.0:1788574256.170703:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11493:x1875455727709312:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788574256.171245:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11493:x1875455727709312:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 551us (780us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788574256.171253:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:2.0:1788574256.174541:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.174887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727709440 00000100:00100000:0.0:1788574256.174912:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727709440 00000100:00100000:0.0:1788574256.175103:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788574256.175114:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11493:x1875455727709440:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:0.0:1788574256.175131:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788574256.175156:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a0d expref: 59 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.175181:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a22 expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.175194:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce39ce expref: 57 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.175205:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70e00) 00010000:00010000:0.0:1788574256.175216:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574256.175315:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:11493:x1875455727709440:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 203us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.175323:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788574256.189795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574256.189976:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727709568 00000100:00100000:1.0:1788574256.189988:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727709568 00000100:00100000:1.0:1788574256.190060:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 169 00000100:00100000:1.0:1788574256.190070:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:11493:x1875455727709568:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:1.0:1788574256.190186:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.190228:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.190241:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574256.190527:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788574256.190612:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:11493:x1875455727709568:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 543us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574256.190620:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 169 00000100:00100000:3.0:1788574256.217157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.217445:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727709696 00000100:00100000:2.0:1788574256.217456:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727709696 00000100:00100000:2.0:1788574256.217523:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00100000:2.0:1788574256.217534:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:11495:x1875455727709696:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574256.217560:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574256.217587:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536494 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a30 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217664:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217679:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217691:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217707:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217715:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217720:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217812:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217836:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217859:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574256.217903:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788574256.217908:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574256.217938:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217950:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217959:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217975:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217982:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217987:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574256.217991:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.217999:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218010:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574256.218013:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574256.218018:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218034:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53649b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218051:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218057:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218062:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218066:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574256.218069:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218074:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218081:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a782d70a00) 00010000:00010000:2.0:1788574256.218084:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574256.218087:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218092:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5364a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218122:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 58 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218146:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 57 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.218153:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:2.0:1788574256.218155:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574256.218158:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984600, rc 0) 00000100:00100000:2.0:1788574256.218225:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11495:x1875455727709696:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 694us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.218232:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 170 00000040:00080000:2.0:1788574256.384676:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574256.384686:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574256.384737:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788574256.384744:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574256.384906:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747632512:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574256.385016:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574256.392110:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bd10c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747632512:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574256.395261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.395719:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727709824 00000100:00100000:3.0:1788574256.395730:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727709824 00000100:00100000:3.0:1788574256.395798:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:3.0:1788574256.395809:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11506:x1875455727709824:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574256.395853:0:5859:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574256.395961:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11506:x1875455727709824:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 153us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.395970:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:3.0:1788574256.399923:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.403218:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727709952 00000100:00100000:2.0:1788574256.403559:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727709952 00000100:00100000:3.0:1788574256.403941:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 172 00000100:00100000:3.0:1788574256.403956:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11506:x1875455727709952:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788574256.404074:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404105:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404120:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404138:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404146:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404153:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404198:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404207:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404214:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574256.404254:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788574256.404258:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574256.404306:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404317:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404331:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404339:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404345:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.404350:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404360:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404401:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574256.404474:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574256.404481:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404488:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5364b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404505:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404512:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404518:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404523:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.404526:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404532:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404539:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff90a784e37a00) 00010000:00010000:3.0:1788574256.404541:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574256.404544:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404549:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404565:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404579:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404585:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404590:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.404593:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404600:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404608:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:3.0:1788574256.404610:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574256.404614:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.404632:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.404726:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11506:x1875455727709952:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 772us (4810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.404735:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 172 00000100:00100000:1.0:1788574256.408021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.408127:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727710208 00000100:00100000:0.0:1788574256.408137:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727710208 00000100:00100000:0.0:1788574256.408719:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 173 00000100:00100000:0.0:1788574256.408735:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11506:x1875455727710208:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574256.408767:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574256.408797:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a37 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.408968:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.408985:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409000:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574256.409015:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788574256.409155:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409163:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409171:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409177:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574256.409181:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409188:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409200:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:0.0:1788574256.409204:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574256.409209:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409227:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.409274:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a37 expref: 59 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.412632:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:0.0:1788574256.412644:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574256.412659:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a37 expref: 59 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.412683:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4cc00, rc 0) 00000100:00100000:0.0:1788574256.412761:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11506:x1875455727710208:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 4031us (4752us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788574256.412771:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 173 00000100:00100000:1.0:1788574256.423796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.424117:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727710336 00000100:00100000:0.0:1788574256.424128:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727710336 00000100:00100000:0.0:1788574256.424196:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 174 00000100:00100000:0.0:1788574256.424208:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11506:x1875455727710336:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574256.424256:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574256.424396:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11506:x1875455727710336:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 190us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.424405:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 174 00000100:00100000:1.0:1788574256.440831:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.440882:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727710592 00000100:00100000:3.0:1788574256.440896:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727710592 00000100:00100000:3.0:1788574256.440964:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:3.0:1788574256.440974:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11506:x1875455727710592:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574256.440995:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574256.441012:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574256.441039:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a29 expref: 58 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.441059:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574256.441065:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574256.441081:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a3e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574256.441624:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788574256.441845:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.441860:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.441871:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.441928:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b5364da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a3e expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.441947:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a3e expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.441955:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:3.0:1788574256.441957:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574256.441961:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7c00, rc 0) 00000100:00100000:3.0:1788574256.442057:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11506:x1875455727710592:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1084us (1247us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788574256.442079:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 175 00010000:00010000:0.0:1788574256.450490:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574256.462009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.462082:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727710848 00000100:00100000:0.0:1788574256.462093:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727710848 00000100:00100000:0.0:1788574256.462165:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:0.0:1788574256.462176:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11506:x1875455727710848:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574256.462235:0:11654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574256.462261:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7c00/0x10531a153b5364e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a3e expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462281:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a784e37a00) 00010000:00010000:0.0:1788574256.462308:0:11654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574256.462334:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462349:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462360:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462396:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462404:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462422:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462486:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462493:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462509:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462515:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574256.462520:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462528:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462536:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574256.462539:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574256.462542:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462548:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b5364ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462558:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462564:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462570:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462575:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574256.462578:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462594:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462601:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd27bb0f3 (ffff90a78544fe00) 00010000:00010000:0.0:1788574256.462604:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574256.462607:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.462613:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5364f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd27bb0f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.462701:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11506:x1875455727710848:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 526us (701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574256.462708:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:0.0:1788574256.468112:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.468195:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727710976 00000100:00100000:2.0:1788574256.468205:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727710976 00000100:00100000:2.0:1788574256.468266:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 177 00000100:00100000:2.0:1788574256.468277:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11506:x1875455727710976:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574256.468310:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574256.468335:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5364fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a45 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.468430:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.468447:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.468460:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.468558:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5364fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.468577:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.468586:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:2.0:1788574256.468589:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574256.468593:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984a00, rc 0) 00000100:00100000:2.0:1788574256.468660:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11506:x1875455727710976:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 385us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.468668:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 177 00000100:00100000:3.0:1788574256.471436:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.471587:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727711232 00000100:00100000:0.0:1788574256.471598:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727711232 00000100:00100000:0.0:1788574256.471650:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 178 00000100:00100000:0.0:1788574256.471659:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11506:x1875455727711232:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574256.471741:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.471759:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.471771:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574256.474323:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788574256.474365:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382648996203ns, next at 383648992485ns, rc = 0 00000004:00010000:0.0:1788574256.475128:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f884b062 reply state 00000000da1ec655 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.475141:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574256.475278:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11506:x1875455727711232:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 3614us (3844us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788574256.475296:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 178 00010000:00010000:0.0:1788574256.477351:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.477389:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.477398:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.477404:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574256.477409:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.477417:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.477435:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:0.0:1788574256.477438:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788574256.477445:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.477453:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53650b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.478905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.478978:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727711360 00000100:00100000:2.0:1788574256.478990:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727711360 00000100:00100000:2.0:1788574256.479055:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 179 00000100:00100000:2.0:1788574256.479065:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a70ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11506:x1875455727711360:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574256.479088:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574256.479109:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a4c expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.479199:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 61 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.479214:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 61 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.479234:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:2.0:1788574256.479237:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574256.479240:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985c00, rc 0) 00000100:00100000:2.0:1788574256.479323:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a70ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11506:x1875455727711360:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 259us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.479330:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 179 00000100:00100000:3.0:1788574256.492766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574256.492865:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727711488 00000100:00100000:1.0:1788574256.492875:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727711488 00000100:00100000:1.0:1788574256.492960:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:1.0:1788574256.492972:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727711488:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788574256.493349:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727711488:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 378us (590us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788574256.493357:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00080000:3.0:1788574256.493935:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574256.499960:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.500093:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727711744 00000100:00100000:2.0:1788574256.500106:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727711744 00000100:00100000:2.0:1788574256.500223:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788574256.500235:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11506:x1875455727711744:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788574256.500513:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11506:x1875455727711744:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 279us (561us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788574256.500520:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:3.0:1788574256.502792:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.502856:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712000 00000100:00100000:2.0:1788574256.502866:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712000 00000100:00100000:2.0:1788574256.502914:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 180 00000100:00100000:2.0:1788574256.502926:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11506:x1875455727712000:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574256.503049:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11506:x1875455727712000:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 125us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.503070:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 180 00000100:00100000:3.0:1788574256.505137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574256.506984:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712128 00000100:00100000:1.0:1788574256.507003:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712128 00000100:00100000:1.0:1788574256.507098:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 181 00000100:00100000:1.0:1788574256.507110:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11506:x1875455727712128:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574256.507134:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574256.507162:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.507263:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.507281:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.507295:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574256.507337:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574256.507361:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.507479:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a53 expref: 64 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.507504:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a53 expref: 63 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.507514:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:1.0:1788574256.507517:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788574256.507522:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21600, rc 0) 00000100:00100000:1.0:1788574256.507604:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+63:11506:x1875455727712128:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 494us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574256.507612:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 181 00000100:00100000:3.0:1788574256.517622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.517674:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712256 00000100:00100000:0.0:1788574256.517684:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712256 00000100:00100000:0.0:1788574256.517823:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:0.0:1788574256.517903:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727712256:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574256.517927:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574256.517955:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a5a expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574256.517987:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a30, blocks: 0x1 00010000:00010000:0.0:1788574256.518010:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788574256.518014:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574256.518026:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 8 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.518046:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 8 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.518060:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574256.521914:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727712256:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 4068us (4289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.521928:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788574256.529764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.529850:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712512 00000100:00100000:0.0:1788574256.529860:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712512 00000100:00100000:0.0:1788574256.529919:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 182 00000100:00100000:0.0:1788574256.529944:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+63:11506:x1875455727712512:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788574256.530054:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+63:11506:x1875455727712512:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 113us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.530063:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 182 00000100:00100000:1.0:1788574256.535671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.536035:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712640 00000100:00100000:3.0:1788574256.536048:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712640 00000100:00100000:3.0:1788574256.536108:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788574256.536120:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:11506:x1875455727712640:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574256.536138:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574256.536160:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a61 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.536191:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 9 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.536201:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574256.536205:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574256.536211:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 9 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.536247:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 9 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.536272:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 9 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.536290:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10306:1875455747632640:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574256.536422:0:10306:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574256.539788:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.539857:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712768 00000100:00100000:0.0:1788574256.539870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712768 00010000:00010000:0.0:1788574256.539915:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 10 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.539965:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:0.0:1788574256.539977:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2355:x1875455727712768:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574256.539998:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574256.540026:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 10 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.540042:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 10 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.540072:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574256.540077:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574256.540088:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 10 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.540099:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 10 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.540163:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 10 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.540178:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1875455747632768:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574256.540272:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69840 going to sleep for 11 seconds 00010000:00010000:1.0:1788574256.540797:0:10306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003eaa26c/0x10531a153b536527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a5a expref: 10 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574256.540847:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10306:1875455747632640:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574256.540872:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 9 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574256.540884:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:1.0:1788574256.540931:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:11506:x1875455727712640:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 4814us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574256.540940:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:1.0:1788574256.549820:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.550996:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1875455747632768:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788574256.551026:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574256.551100:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727712768:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 11123us (11323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.551112:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:2.0:1788574256.558990:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727712896 00000100:00100000:2.0:1788574256.559016:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727712896 00002000:00100000:2.0:1788574256.559092:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90a68214ca80 x1875455727712896/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:407/0 lens 504/0 e 0 to 0 dl 1788574267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574256.559103:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a68214ca80 with x1875455727712896 ext(0->8) 00002000:00010000:2.0:1788574256.559110:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a68214ca80 00000100:00100000:2.0:1788574256.559704:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574256.559717:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727712896:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788574256.560257:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2355:x1875455727712896:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 540us (10453us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788574256.560267:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00002000:00100000:2.0:1788574256.560275:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90a68214ca80 x1875455727712896/t4294967314(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:407/0 lens 504/448 e 0 to 0 dl 1788574267 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574256.560284:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a68214ca80 with x1875455727712896 ext(0->8) 00002000:00010000:2.0:1788574256.560288:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a68214ca80 00000100:00100000:1.0:1788574256.567804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.568053:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727713024 00000100:00100000:3.0:1788574256.568066:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727713024 00000100:00100000:3.0:1788574256.568129:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 183 00000100:00100000:3.0:1788574256.568139:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+63:11506:x1875455727713024:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788574256.643294:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788574256.643308:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788574256.643398:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788574256.643417:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a79e7f8b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788574256.643423:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a79335f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a79e7f8300 00000020:00080000:2.0:1788574256.643426:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a79335f500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a79218f400 00000001:00080000:2.0:1788574256.643451:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:2.0:1788574256.643689:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747632896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788574256.643771:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574256.643877:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747632896 00000100:00100000:2.0:1788574256.643887:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747632896 00000100:00100000:2.0:1788574256.643950:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574256.643962:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747632896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788574256.643991:0:6713:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788574256.644035:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b7a2d, atime: 0x6a9b7a2e, ctime: 0x6a9b7a2d, blocks: 0xb 00010000:00010000:2.0:1788574256.644047:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644068:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1788574256.644074:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574256.644082:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644105:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644117:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644126:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644147:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788574256.644847:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747632896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 884us (1072us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788574256.644863:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788574256.644900:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788574256.644914:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574256.644922:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644932:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574256.644937:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644947:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644964:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644971:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.644991:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574256.644993:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574256.644994:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574256.645028:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788574256.645036:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788574256.645063:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90a79b051880 x1875455747632896/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788574272 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788574256.645076:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a79b051880/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788574256.645088:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747632896:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788574256.645902:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11506:x1875455727713024:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 77759us (78104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.645912:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 183 00000100:00100000:2.0:1788574256.646830:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:3.0:1788574256.646934:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788574256.647132:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788574256.647184:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747633024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788574256.647244:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574256.647454:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747633024 00000100:00100000:3.0:1788574256.647462:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747633024 00000100:00100000:3.0:1788574256.647519:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574256.647529:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747633024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788574256.647678:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788574256.647682:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788574256 00002000:00010000:3.0:1788574256.647685:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788574256.647687:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788574256 -> 1788574256 00002000:00010000:3.0:1788574256.647689:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788574256.647744:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747633024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (500us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788574256.647751:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788574256.647983:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788574256.648019:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a68214e680/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788574256.648026:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747633024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788574256.669151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.669405:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727713152 00000100:00100000:3.0:1788574256.669417:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727713152 00000100:00100000:3.0:1788574256.669485:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:3.0:1788574256.669496:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2355:x1875455727713152:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788574256.744262:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2355:x1875455727713152:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 74755us (75111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574256.744279:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000001:00080000:2.0:1788574256.744364:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788574256.744396:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1788574256.744410:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788574256.752097:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.752177:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727713408 00000100:00100000:3.0:1788574256.752189:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727713408 00000100:00100000:3.0:1788574256.752259:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 184 00000100:00100000:3.0:1788574256.752271:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11506:x1875455727713408:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574256.752330:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574256.752416:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a53 expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.752438:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:3.0:1788574256.752444:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574256.752475:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.752488:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.752500:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574256.752767:0:10109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079c5aac2 reply state 00000000e3d6dddc transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.752795:0:10109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574256.752900:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:11506:x1875455727713408:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 631us (816us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788574256.752908:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 184 00000100:00100000:1.0:1788574256.757934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.758081:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727713536 00000100:00100000:2.0:1788574256.758095:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727713536 00000100:00100000:2.0:1788574256.758172:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:2.0:1788574256.758185:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727713536:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788574256.758457:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788574256.758460:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788574256 -> 1788574255 00002000:00010000:2.0:1788574256.758462:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788574254 00002000:00010000:2.0:1788574256.758464:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788574256 -> 1788574255 00002000:00010000:2.0:1788574256.758466:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788574256.758519:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727713536:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 337us (597us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788574256.758526:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00010000:00010000:3.0:1788574256.759679:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.759694:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.759701:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.759707:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.759713:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.759720:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.759737:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:3.0:1788574256.759741:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574256.759745:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.759752:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b53653c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574256.778854:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.785462:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727713792 00000100:00100000:0.0:1788574256.785479:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727713792 00000100:00100000:0.0:1788574256.785561:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 185 00000100:00100000:0.0:1788574256.785573:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11506:x1875455727713792:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788574256.785645:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.785663:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.785819:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.785860:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.785888:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 18 pid: 5857 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.785904:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747633152:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574256.786002:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574256.789072:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.789075:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747633152:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574256.789115:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.795063:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727713920 00000100:00100000:3.0:1788574256.795081:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727713920 00010000:00010000:0.0:1788574256.796692:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 19 pid: 5857 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.796747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:0.0:1788574256.796760:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b107050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:2356:x1875455727713920:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574256.796778:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574256.796786:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 19 pid: 5857 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.796802:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 19 pid: 5857 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.796842:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a45 expref: 19 pid: 5857 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.796859:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:0.0:1788574256.796872:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.796883:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.796891:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.796931:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574256.797017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b107050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:2356:x1875455727713920:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 259us (7963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.797026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00010000:00010000:3.0:1788574256.797225:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797237:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797271:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797279:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797483:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797489:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.797494:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797501:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797513:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:3.0:1788574256.797516:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788574256.797520:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.797526:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536543 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.797592:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:11506:x1875455727713792:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 12019us (18747us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788574256.797600:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 185 00000100:00100000:3.0:1788574256.804745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.804832:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727714048 00000100:00100000:0.0:1788574256.804843:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727714048 00000100:00100000:0.0:1788574256.804905:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:0.0:1788574256.804916:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727714048:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788574256.804976:0:12090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.805002:0:12090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.805011:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574256.805016:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574256.805023:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.805071:0:12090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.805096:0:12090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 8 pid: 10306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.805114:0:12090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12090:1875455747633280:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574256.805209:0:12090:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574256.809037:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574256.813731:0:12090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12090:1875455747633280:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574256.813764:0:12090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.813936:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727714176 00000100:00100000:3.0:1788574256.813945:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727714176 00010000:00010000:3.0:1788574256.813986:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 9 pid: 10306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.814032:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788574256.814042:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727714176:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574256.814058:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574256.814085:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 9 pid: 10306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.814100:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 9 pid: 10306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.814125:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b53652e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a61 expref: 9 pid: 10306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.814142:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574256.814146:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574256.814153:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.814163:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.814189:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574256.814273:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727714176:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 232us (5246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.814282:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00010000:00010000:2.0:1788574256.815037:0:12090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815052:0:12090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815085:0:12090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815094:0:12090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815104:0:12090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815112:0:12090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574256.815116:0:12090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815127:0:12090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815143:0:12090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.815166:0:12090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c2ec56c/0x10531a153b53654a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574256.815259:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727714048:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 10340us (10517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.815268:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:3.0:1788574256.822220:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.822265:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727714432 00000100:00100000:3.0:1788574256.822274:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727714432 00000100:00100000:3.0:1788574256.822325:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 186 00000100:00100000:3.0:1788574256.822352:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+17:11506:x1875455727714432:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788574256.822458:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.822477:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.822490:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.822946:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.822960:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.822969:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.823005:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 18 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.823019:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 18 pid: 10109 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.823043:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747633408:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574256.823140:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574256.829186:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747633408:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574256.829228:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.831191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574256.831444:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727714560 00000100:00100000:0.0:1788574256.831454:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727714560 00010000:00010000:0.0:1788574256.831495:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 19 pid: 10109 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574256.831538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:0.0:1788574256.831548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:2355:x1875455727714560:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574256.831564:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574256.831571:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 19 pid: 10109 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831586:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 19 pid: 10109 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831610:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b536512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a4c expref: 19 pid: 10109 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831644:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:0.0:1788574256.831650:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831659:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831668:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831696:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574256.831748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:2355:x1875455727714560:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 201us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.831755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00010000:00010000:0.0:1788574256.831782:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.831791:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574256.832010:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788574256.832171:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788574256.832217:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788574256.832585:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1875455747633536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788574256.832657:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574256.832689:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574256.832827:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747633536 00000100:00100000:3.0:1788574256.832834:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747633536 00000100:00100000:3.0:1788574256.832885:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574256.832894:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875455747633536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788574256.832976:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875455747633536:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.832983:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574256.833065:0:5857:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788574256.833073:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a68214e680, transno 4294967315 00000100:00100000:2.0:1788574256.833097:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1875455747633536:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788574256.833664:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788574256.833730:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1875455747633664:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788574256.833770:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574256.833793:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574256.834011:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747633664 00000100:00100000:3.0:1788574256.834019:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747633664 00000100:00100000:3.0:1788574256.834049:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574256.834058:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875455747633664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788574256.834247:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1875455747633664:12345-0@lo:1000:mdt00_000.0 Request processed in 190us (476us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788574256.834256:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574256.834442:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1875455747633664:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788574256.834478:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834489:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834497:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834505:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574256.834510:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834532:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834550:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a782d70a00) 00010000:00010000:2.0:1788574256.834553:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574256.834559:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834565:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7e00/0x10531a153b536558 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834600:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834608:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834615:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834622:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574256.834625:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834631:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834640:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:2.0:1788574256.834642:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574256.834645:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834661:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b53648d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834688:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834702:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 21 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834712:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834745:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 21 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574256.834761:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 21 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574256.834775:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747633792:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574256.834852:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574256.842888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.843463:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727714688 00000100:00100000:3.0:1788574256.843475:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727714688 00010000:00010000:3.0:1788574256.843528:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 22 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.843578:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:3.0:1788574256.843591:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2356:x1875455727714688:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574256.843623:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574256.843633:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 22 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843650:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 22 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843677:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:3.0:1788574256.843682:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843692:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843699:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843721:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574256.843781:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2356:x1875455727714688:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 192us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.843789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 71 00010000:00010000:3.0:1788574256.843866:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b5364a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a30 expref: 21 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.843886:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1875455747633792:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574256.843915:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843925:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843939:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843953:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843961:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843968:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843975:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.843981:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.843989:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844001:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:3.0:1788574256.844004:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574256.844008:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844016:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b53655f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844030:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844036:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844049:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844056:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574256.844060:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844067:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844079:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a7b2398400) 00010000:00010000:3.0:1788574256.844082:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574256.844085:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.844092:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536551 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574256.844417:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11506:x1875455727714432:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 22066us (22207us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788574256.844428:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 186 00000020:00080000:3.0:1788574256.844433:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788574256.845672:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574256.845682:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574256.846189:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788574256.846198:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574256.857635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574256.857700:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727714944 00000100:00100000:3.0:1788574256.857711:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727714944 00000100:00100000:3.0:1788574256.857771:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:3.0:1788574256.857783:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7861dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11506:x1875455727714944:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788574256.858646:0:5861:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788574256.858746:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788574256.858796:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.858826:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.858838:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.858850:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.858856:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.858862:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574256.858886:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788574256.858980:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7861dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:11506:x1875455727714944:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 1197us (1357us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788574256.858991:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000020:00080000:3.0:1788574256.858996:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788574256.859791:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574256.859802:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.859832:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574256.859837:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.859847:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.859862:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90a784e37100) 00010000:00010000:0.0:1788574256.859865:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788574256.859871:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.859877:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536566 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574256.859895:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574256.859897:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574256.859899:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574257.223590:0:12484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574257.223604:0:12484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574257.223650:0:12484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788574257.223657:0:12484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574257.286018:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747633920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574257.286119:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574257.286243:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747633920 00000100:00100000:2.0:1788574257.286255:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747633920 00000100:00100000:2.0:1788574257.286314:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788574257.286324:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747633920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574257.286400:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788574257.286453:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747633920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574257.286462:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788574257.286614:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747633920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574257.384291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574257.384520:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727715200 00000100:00100000:1.0:1788574257.384530:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727715200 00000100:00100000:1.0:1788574257.384647:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 187 00000100:00100000:1.0:1788574257.384659:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:11516:x1875455727715200:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574257.384712:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574257.384741:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53656d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a68 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.384882:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536574 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.384900:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.384913:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536574 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574257.384925:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788574257.385075:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b53656d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a68 expref: 25 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.385098:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a68 expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.385107:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574257.385110:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788574257.385115:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21e00, rc 0) 00000100:00100000:1.0:1788574257.385182:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:11516:x1875455727715200:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 526us (903us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788574257.385189:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 187 00000100:00080000:3.0:1788574257.391187:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574257.391364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.391580:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727715328 00000100:00100000:3.0:1788574257.391591:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727715328 00000100:00100000:3.0:1788574257.391655:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 188 00000100:00100000:3.0:1788574257.391677:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:11516:x1875455727715328:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788574257.391762:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.391795:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.391817:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.391831:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.391839:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.391846:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392113:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392120:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392126:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574257.392167:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392179:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392186:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392202:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392208:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.392213:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392221:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392233:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574257.392236:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.392240:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392247:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b536582 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392258:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392263:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392268:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392273:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.392276:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392290:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392298:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a784e37900) 00010000:00010000:3.0:1788574257.392300:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.392303:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392309:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392324:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392342:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392348:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392353:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.392355:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392361:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392392:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574257.392394:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.392398:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.392413:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574257.392491:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:11516:x1875455727715328:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 824us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.392499:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 188 00000100:00100000:0.0:1788574257.455011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.455093:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727715584 00000100:00100000:3.0:1788574257.455104:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727715584 00000100:00100000:3.0:1788574257.455168:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 189 00000100:00100000:3.0:1788574257.455179:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+24:11519:x1875455727715584:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574257.455200:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574257.455222:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a6f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455298:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455314:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455338:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455354:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455361:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455412:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455687:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455695:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455703:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574257.455713:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788574257.455808:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455815:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455822:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455827:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.455831:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455838:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455850:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574257.455853:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.455863:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455870:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53659e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455884:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455890:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455895:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455900:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.455902:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455907:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455914:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a784e37400) 00010000:00010000:3.0:1788574257.455916:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.455918:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455923:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455961:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 27 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455988:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.455995:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574257.455997:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574257.456000:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7000, rc 0) 00000100:00100000:3.0:1788574257.456081:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11519:x1875455727715584:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 904us (1084us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788574257.456089:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 189 00000100:00100000:0.0:1788574257.473480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574257.473555:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727715712 00000100:00100000:0.0:1788574257.473565:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727715712 00000100:00100000:0.0:1788574257.473617:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 190 00000100:00100000:0.0:1788574257.473627:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11519:x1875455727715712:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:0.0:1788574257.473704:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473739:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473752:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473789:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473807:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473815:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473821:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574257.473826:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473836:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473849:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:0.0:1788574257.473853:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574257.473858:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.473865:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5365ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.473953:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11519:x1875455727715712:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 327us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.473969:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 190 00010000:00010000:0.0:1788574257.474002:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574257.483883:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574257.483928:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727715968 00000100:00100000:1.0:1788574257.483938:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727715968 00000100:00100000:1.0:1788574257.484004:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574257.484015:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11519:x1875455727715968:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788574257.484260:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:11519:x1875455727715968:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 246us (387us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788574257.484269:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:0.0:1788574257.548180:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574257.548284:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727716224 00000100:00100000:2.0:1788574257.548295:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727716224 00000100:00100000:2.0:1788574257.548409:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 191 00000100:00100000:2.0:1788574257.548422:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:11052:x1875455727716224:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574257.548448:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574257.548474:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5365c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a76 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.548619:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.548635:0:10109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 28 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.548645:0:10109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.549089:0:10109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 28 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.549109:0:10109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 28 pid: 5857 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574257.549151:0:10109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747634048:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574257.549273:0:10109:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574257.554310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.554809:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727716352 00000100:00100000:3.0:1788574257.554820:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727716352 00010000:00010000:3.0:1788574257.554868:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 29 pid: 5857 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574257.554913:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:3.0:1788574257.554923:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:2356:x1875455727716352:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574257.554939:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574257.554947:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 29 pid: 5857 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.554960:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 29 pid: 5857 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.554986:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574257.554991:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.555017:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.555026:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.555049:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574257.555115:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:2356:x1875455727716352:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 192us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.555123:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 72 00010000:00010000:2.0:1788574257.562849:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5365ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a6f expref: 28 pid: 5857 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574257.562882:0:10109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10109:1875455747634048:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574257.562909:0:10109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.562921:0:10109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.562927:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574257.562956:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788574257.563171:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5365c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 29 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.563188:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 28 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.563200:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:2.0:1788574257.563203:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574257.563207:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574257.563293:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:11052:x1875455727716224:12345-192.168.201.57@tcp:101:bash.0 Request processed in 14873us (15123us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788574257.563317:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 191 00000100:00100000:1.0:1788574257.578021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574257.578431:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727716608 00000100:00100000:0.0:1788574257.578443:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727716608 00000100:00100000:0.0:1788574257.578516:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 192 00000100:00100000:0.0:1788574257.578527:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:11052:x1875455727716608:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:0.0:1788574257.578829:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.578846:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.578858:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574257.578907:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788574257.578933:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a20ac56 reply state 00000000b04d2ab5 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.578941:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788574257.578985:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788574257.579100:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11052:x1875455727716608:12345-192.168.201.57@tcp:36:bash.0 Request processed in 574us (1089us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788574257.579108:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 192 00000020:00080000:0.0:1788574257.579113:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788574257.583460:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.583485:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.583494:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.583498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788574257.583501:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.583515:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.583525:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.583545:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574257.583549:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.583554:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.583588:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5365d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574257.583612:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727716736 00000100:00100000:1.0:1788574257.583622:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727716736 00000100:00100000:1.0:1788574257.583688:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 193 00000100:00100000:1.0:1788574257.583697:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:11052:x1875455727716736:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788574257.583721:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574257.583737:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b5365dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a7d expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.583812:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b5365dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a7d expref: 32 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.583827:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b5365dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a7d expref: 32 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.583849:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:1.0:1788574257.583852:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574257.583855:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574257.583921:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11052:x1875455727716736:12345-192.168.201.57@tcp:101:bash.0 Request processed in 224us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574257.583928:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 193 00000100:00100000:1.0:1788574257.587482:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.587615:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727716864 00000100:00100000:3.0:1788574257.587626:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727716864 00000100:00100000:3.0:1788574257.587753:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:3.0:1788574257.587764:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:11052:x1875455727716864:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574257.587780:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574257.587810:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a84 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574257.587835:0:10306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b7a2f, atime: 0x6a9b7a2e, ctime: 0x6a9b7a2f, blocks: 0xb 00010000:00010000:3.0:1788574257.587855:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1788574257.587859:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574257.587867:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.587885:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 8 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.587896:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6a00, rc 0) 00000100:00100000:3.0:1788574257.587960:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:11052:x1875455727716864:12345-192.168.201.57@tcp:101:bash.0 Request processed in 199us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.587968:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:0.0:1788574257.590582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.591290:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727716992 00000100:00100000:3.0:1788574257.591307:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727716992 00002000:00010000:3.0:1788574257.591354:0:6719:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788574257.591358:0:6719:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bb28ca80 with x1875455727716992 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574257.591404:0:6719:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bb28ca80. 00000100:00100000:3.0:1788574257.591433:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788574257.591444:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727716992:12345-192.168.201.57@tcp:10:bash.0 00002000:00010000:3.0:1788574257.591765:0:6719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788574257.591770:0:6719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788574255 -> 1788574257 00002000:00010000:3.0:1788574257.591772:0:6719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788574254 -> 1788574254 00002000:00010000:3.0:1788574257.591774:0:6719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788574255 -> 1788574257 00002000:00010000:3.0:1788574257.591776:0:6719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788574257.591858:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727716992:12345-192.168.201.57@tcp:10:bash.0 Request processed in 416us (1288us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788574257.591867:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00002000:00010000:3.0:1788574257.591870:0:6719:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788574257.591873:0:6719:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bb28ca80 with x1875455727716992 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574257.591878:0:6719:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bb28ca80. 00000100:00100000:0.0:1788574257.669902:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.670437:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727717120 00000100:00100000:3.0:1788574257.670448:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727717120 00000100:00100000:3.0:1788574257.670513:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 194 00000100:00100000:3.0:1788574257.670524:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11533:x1875455727717120:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788574257.670610:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.670630:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.670673:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.670691:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.670698:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.670705:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671036:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671046:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671053:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574257.671103:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671116:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671123:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671135:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671150:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.671155:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671164:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671176:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574257.671179:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.671184:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671191:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5365eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671204:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671209:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671214:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671218:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.671221:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671226:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671242:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a784e37b00) 00010000:00010000:3.0:1788574257.671244:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.671247:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671252:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b5365f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671269:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671276:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671280:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671284:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.671285:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671289:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671293:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574257.671294:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.671296:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.671299:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5365f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574257.671664:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11533:x1875455727717120:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1128us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.671674:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 194 00000100:00100000:1.0:1788574257.718003:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574257.718069:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727717376 00000100:00100000:0.0:1788574257.718079:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727717376 00000100:00100000:0.0:1788574257.718143:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 195 00000100:00100000:0.0:1788574257.718154:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+32:11536:x1875455727717376:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574257.718176:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574257.718201:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a8b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.718269:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.718283:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.718295:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.718311:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.718318:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.718324:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718752:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718760:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718765:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574257.718773:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788574257.718886:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718895:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718902:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718908:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574257.718912:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718921:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718934:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574257.718937:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574257.718942:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718949:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718972:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718978:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718984:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718989:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574257.718993:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.718998:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.719006:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a78544f800) 00010000:00010000:1.0:1788574257.719009:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574257.719011:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.719017:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53660e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.719069:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b536600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a8b expref: 35 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.719085:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a8b expref: 34 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.719105:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:1.0:1788574257.719107:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788574257.719110:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21600, rc 0) 00000100:00100000:1.0:1788574257.719191:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11536:x1875455727717376:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1038us (1201us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788574257.719199:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 195 00000100:00100000:2.0:1788574257.722757:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574257.722877:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727717504 00000100:00100000:1.0:1788574257.722888:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727717504 00000100:00100000:1.0:1788574257.723007:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 196 00000100:00100000:1.0:1788574257.723020:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11536:x1875455727717504:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788574257.723121:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.723138:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 34 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.723147:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.723183:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 34 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.723197:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 34 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574257.723214:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747634176:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574257.723340:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c94db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574257.730140:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.730264:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727717760 00000100:00100000:1.0:1788574257.730272:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747634176:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574257.730274:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727717760 00010000:00010000:1.0:1788574257.730299:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574257.730409:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788574257.730422:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:5592:x1875455727717760:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788574257.730830:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+36:5592:x1875455727717760:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 409us (702us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788574257.730838:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788574257.734869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574257.734969:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727717888 00000100:00100000:0.0:1788574257.734980:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727717888 00010000:00010000:0.0:1788574257.735021:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 36 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.735081:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:0.0:1788574257.735093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+36:2356:x1875455727717888:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574257.735107:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574257.735115:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 36 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.735129:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 36 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.735152:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5365c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a76 expref: 36 pid: 10109 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.735167:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:0.0:1788574257.735173:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.735182:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.735190:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.735224:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574257.735291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:2356:x1875455727717888:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 201us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.735298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00010000:00010000:1.0:1788574257.735404:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735414:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735448:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735455:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735461:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735466:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574257.735470:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735477:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735486:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:1.0:1788574257.735489:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574257.735492:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.735508:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574257.735552:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11536:x1875455727717504:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 12534us (13236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574257.735559:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 196 00000100:00100000:3.0:1788574257.738775:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574257.738890:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727718144 00000100:00100000:2.0:1788574257.738901:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727718144 00000100:00100000:2.0:1788574257.738969:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:2.0:1788574257.738982:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+34:11536:x1875455727718144:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574257.739269:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:11536:x1875455727718144:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 289us (502us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788574257.739278:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788574257.814498:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.814678:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727718400 00000100:00100000:3.0:1788574257.814688:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727718400 00000100:00100000:3.0:1788574257.814764:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 197 00000100:00100000:3.0:1788574257.814775:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+35:11547:x1875455727718400:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788574257.814832:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574257.814858:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53662a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a92 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.814957:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.814975:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.814991:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815016:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815024:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815033:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815405:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53663f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815416:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815424:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574257.815435:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788574257.815538:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815546:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815554:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815560:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.815564:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815581:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815594:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574257.815597:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.815602:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815609:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815623:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815627:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815632:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815637:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.815640:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815644:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815650:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a784e37b00) 00010000:00010000:3.0:1788574257.815652:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.815655:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815668:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b536638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815709:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53662a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a92 expref: 38 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815721:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53663f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a92 expref: 37 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.815729:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:3.0:1788574257.815731:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574257.815734:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6e00, rc 0) 00000100:00100000:3.0:1788574257.815814:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11547:x1875455727718400:12345-192.168.201.57@tcp:101:cat.0 Request processed in 1040us (1332us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788574257.815821:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 197 00000100:00100000:0.0:1788574257.822837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574257.822956:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727718656 00000100:00100000:2.0:1788574257.822966:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727718656 00000100:00100000:2.0:1788574257.823025:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:2.0:1788574257.823037:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11547:x1875455727718656:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:2.0:1788574257.823316:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:11547:x1875455727718656:12345-192.168.201.57@tcp:35:cat.0 Request processed in 280us (489us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788574257.823325:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:1.0:1788574257.859756:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574257.859866:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727718912 00000100:00100000:2.0:1788574257.859876:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727718912 00000100:00100000:2.0:1788574257.859942:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 198 00000100:00100000:2.0:1788574257.859954:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:11548:x1875455727718912:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:2.0:1788574257.860019:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788574257.860049:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53663f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a92 expref: 38 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860073:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a8b expref: 37 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860102:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b5365dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a7d expref: 36 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860113:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a784e37900) 00010000:00010000:2.0:1788574257.860123:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574257.860143:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860155:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860163:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860176:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860182:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860189:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860489:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860498:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.860504:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574257.861107:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788574257.861118:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384035748873ns, next at 385035746698ns, rc = 0 00010000:00010000:2.0:1788574257.861262:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861273:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861281:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861289:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861295:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861301:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861359:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574257.861404:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861410:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861416:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861422:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574257.861433:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861441:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861452:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70700) 00010000:00010000:2.0:1788574257.861455:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788574257.861458:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861465:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53665b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861483:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861490:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861496:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861500:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574257.861503:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861509:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861515:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574257.861517:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574257.861526:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.861532:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53664d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574257.862611:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000078fc5c3 reply state 00000000a6172809 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574257.862628:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574257.862738:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+37:11548:x1875455727718912:12345-192.168.201.57@tcp:36:rm.0 Request processed in 2782us (2987us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788574257.862747:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 198 00010000:00010000:1.0:1788574257.864944:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574257.864965:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.864978:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574257.864983:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.864994:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.865021:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90a782d70700) 00010000:00010000:1.0:1788574257.865025:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788574257.865031:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.865038:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536662 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574257.865070:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574257.865072:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574257.865074:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574257.868254:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.868273:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.868281:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.868287:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.868293:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.868301:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.868337:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a782d70a00) 00010000:00010000:3.0:1788574257.868340:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.868345:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.868352:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536654 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574257.925104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574257.925412:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727719168 00000100:00100000:0.0:1788574257.925426:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727719168 00000100:00100000:0.0:1788574257.925500:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 199 00000100:00100000:0.0:1788574257.925520:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+36:11553:x1875455727719168:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574257.925548:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574257.925571:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536669 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3a99 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.925685:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.925711:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.925724:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.925739:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.925746:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.925752:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574257.926555:0:11654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788574257.926746:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926772:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926782:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926835:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926843:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926850:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926857:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574257.926861:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926869:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926881:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574257.926884:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574257.926889:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926895:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536670 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574257.926909:0:11654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b50e004 reply state 0000000045a69bb7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.926927:0:11654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788574257.926960:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536669 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 39 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926974:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 38 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.926982:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574257.926984:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574257.926987:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c800, rc 0) 00000100:00100000:0.0:1788574257.927079:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:11553:x1875455727719168:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1562us (1988us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788574257.927088:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 199 00010000:00010000:3.0:1788574257.929296:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.929323:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.929331:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.929337:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574257.929342:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.929350:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.929403:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a78544ff00) 00010000:00010000:3.0:1788574257.929407:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574257.929413:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.929419:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536677 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574257.930681:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.930950:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727719296 00000100:00100000:3.0:1788574257.930962:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727719296 00000100:00100000:3.0:1788574257.931036:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:3.0:1788574257.931047:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727719296:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574257.931065:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574257.931086:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3aa0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574257.931113:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574257.931132:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1788574257.931136:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574257.931146:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.931165:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574257.931179:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6800, rc 0) 00000100:00100000:3.0:1788574257.931237:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2356:x1875455727719296:12345-192.168.201.57@tcp:101:bash.0 Request processed in 191us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.931243:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00080000:2.0:1788574257.931664:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574257.933879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574257.934244:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727719424 00000100:00100000:2.0:1788574257.934254:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727719424 00000100:00100000:2.0:1788574257.934314:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:2.0:1788574257.934331:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:11553:x1875455727719424:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574257.934349:0:12090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574257.934407:0:12090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3aa7 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.934439:0:12090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.934449:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574257.934453:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574257.934458:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 7 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.934510:0:12090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.934523:0:12090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 7 pid: 6712 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574257.934537:0:12090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12090:1875455747634304:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574257.934609:0:12090:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574257.941856:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574257.942019:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727719552 00000100:00100000:0.0:1788574257.942031:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727719552 00010000:00010000:0.0:1788574257.942084:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 8 pid: 6712 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.942134:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:0.0:1788574257.942145:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727719552:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574257.942161:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574257.942185:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 8 pid: 6712 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.942220:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 8 pid: 6712 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.942244:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574257.942249:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574257.942258:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 8 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.942269:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 8 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574257.942310:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 8 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574257.942332:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7bec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1875455747634432:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574257.942451:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79016e180 going to sleep for 11 seconds 00010000:00010000:2.0:1788574257.942546:0:12090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a66a13d/0x10531a153b53668c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa0 expref: 8 pid: 6712 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574257.942561:0:12090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12090:1875455747634304:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574257.942587:0:12090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 7 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574257.942599:0:12090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574257.942626:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:11553:x1875455727719424:12345-192.168.201.57@tcp:101:bash.0 Request processed in 8297us (8757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574257.942634:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:0.0:1788574257.945105:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7bec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1875455747634432:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788574257.945140:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574257.945211:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2355:x1875455727719552:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 3067us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.945224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:3.0:1788574257.945927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574257.946466:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727719808 00000100:00100000:1.0:1788574257.946476:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727719808 00000100:00100000:1.0:1788574257.946534:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788574257.946544:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+38:11553:x1875455727719808:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:1.0:1788574257.946916:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:11553:x1875455727719808:12345-192.168.201.57@tcp:35:bash.0 Request processed in 371us (993us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788574257.946924:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788574257.974060:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574257.974109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574257.974149:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574257.974235:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727719936 00000100:00100000:3.0:1788574257.974246:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727719936 00000100:00100000:3.0:1788574257.974299:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 300 00000100:00100000:3.0:1788574257.974309:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727719936:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574257.974434:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727719936:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 126us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.974445:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 300 00000100:00100000:0.0:1788574257.974735:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727720192 00000100:00100000:0.0:1788574257.974740:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727720192 00000100:00100000:0.0:1788574257.974813:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00100000:0.0:1788574257.974828:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727720192:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574257.974877:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2354:x1875455727720192:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 50us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.974883:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00080000:3.0:1788574257.975117:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574257.977953:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727720064 00000100:00100000:2.0:1788574257.977971:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727720064 00000100:00100000:2.0:1788574257.978106:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:2.0:1788574257.978119:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2354:x1875455727720064:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574257.978270:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2354:x1875455727720064:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 153us (4119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574257.978279:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:0.0:1788574258.163404:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.163545:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727720320 00000100:00100000:2.0:1788574258.163555:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727720320 00000100:00100000:2.0:1788574258.163617:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 200 00000100:00100000:2.0:1788574258.163635:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+39:11570:x1875455727720320:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574258.163662:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574258.163689:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53669a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3aae expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.163821:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5366a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.163839:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5366a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.163853:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5366a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574258.163899:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788574258.163904:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574258.163927:0:5859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5366a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.163954:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53669a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aae expref: 41 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.163974:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5366a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aae expref: 40 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.163992:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574258.163995:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574258.163999:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984a00, rc 0) 00000100:00100000:2.0:1788574258.164067:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11570:x1875455727720320:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 434us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574258.164074:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 200 00000100:00100000:0.0:1788574258.174361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.174491:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727720576 00000100:00100000:2.0:1788574258.174505:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727720576 00000100:00100000:2.0:1788574258.174578:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 201 00000100:00100000:2.0:1788574258.174590:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+40:11570:x1875455727720576:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574258.174627:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574258.174662:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5366a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3ab5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.174807:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5366af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.174824:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5366af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.174838:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5366af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574258.174852:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788574258.175032:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5366a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ab5 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.175074:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5366af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ab5 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.175082:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.175085:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574258.175088:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574258.175165:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:11570:x1875455727720576:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 577us (813us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788574258.175173:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 201 00000100:00100000:1.0:1788574258.178277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.180436:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727720704 00000100:00100000:3.0:1788574258.180453:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727720704 00000100:00100000:3.0:1788574258.180546:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788574258.180559:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+42:2355:x1875455727720704:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574258.180577:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574258.180610:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b5366af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ab5 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.180642:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574258.180647:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574258.180724:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:2355:x1875455727720704:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 169us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.180732:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788574258.181844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.181933:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727720960 00000100:00100000:0.0:1788574258.181946:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727720960 00000100:00100000:0.0:1788574258.182016:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 202 00000100:00100000:0.0:1788574258.182027:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+41:11570:x1875455727720960:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574258.182058:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.182087:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3abc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.182239:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.182259:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.182274:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574258.182288:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788574258.182480:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3abc expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.182499:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3abc expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.182524:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.182528:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788574258.182532:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574258.182579:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:11570:x1875455727720960:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 554us (746us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788574258.182586:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 202 00000100:00100000:0.0:1788574258.210302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.210553:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727721088 00000100:00100000:3.0:1788574258.210565:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727721088 00000100:00100000:3.0:1788574258.210652:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:3.0:1788574258.210666:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+6:2353:x1875455727721088:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:3.0:1788574258.210736:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.210760:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 6 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.210798:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574258.210803:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574258.210808:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.210848:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 6 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.210862:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 6 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574258.210878:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6713:1875455747634560:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574258.210986:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574258.215127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.215216:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727721216 00000100:00100000:2.0:1788574258.215226:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727721216 00002000:00100000:2.0:1788574258.215276:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90a6839d2300 x1875455727721216/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:409/0 lens 504/0 e 0 to 0 dl 1788574269 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574258.215287:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6839d2300 with x1875455727721216 ext(0->8) 00010000:00010000:2.0:1788574258.215297:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 7 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.215322:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 7 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574258.215330:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a6839d2300 00000100:00100000:2.0:1788574258.215362:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:2.0:1788574258.215402:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727721216:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:3.0:1788574258.216246:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6713:1875455747634560:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574258.216275:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574258.216325:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2356:x1875455727721216:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 917us (1202us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788574258.216340:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00002000:00100000:2.0:1788574258.216348:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90a6839d2300 x1875455727721216/t4294967308(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:409/0 lens 504/448 e 0 to 0 dl 1788574269 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574258.216357:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6839d2300 with x1875455727721216 ext(0->8) 00010000:00010000:2.0:1788574258.216363:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 9 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.216400:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 9 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574258.216408:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a6839d2300 00000100:00100000:1.0:1788574258.230337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.230543:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727721344 00000100:00100000:0.0:1788574258.230553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727721344 00010000:00010000:0.0:1788574258.230606:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 9 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.230657:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:0.0:1788574258.230668:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727721344:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574258.230683:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788574258.230871:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788574258.230875:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788574258 00002000:00010000:0.0:1788574258.230878:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788574258 00002000:00010000:0.0:1788574258.230880:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788574258 00010000:00010000:0.0:1788574258.230888:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 9 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.230904:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 9 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.230948:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536693 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aa7 expref: 9 pid: 12090 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.230966:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574258.230972:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574258.230978:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.230989:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.231026:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574258.231149:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231160:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231186:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231201:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231210:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231217:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574258.231233:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231242:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231253:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.231260:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e99bcc4/0x10531a153b5366d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.231324:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727721344:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 657us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.231332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:3.0:1788574258.237421:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2353:x1875455727721088:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 26740us (27114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.237440:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:0.0:1788574258.254261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574258.254485:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727721600 00000100:00100000:1.0:1788574258.254499:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727721600 00000100:00100000:1.0:1788574258.254593:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:1.0:1788574258.254607:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7861dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+43:11570:x1875455727721600:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:1.0:1788574258.254684:0:5861:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3abc expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574258.254993:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788574258.255041:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788574258.257990:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788574258.258145:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.258174:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 47 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.258184:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.258248:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 47 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.258292:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 47 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.258327:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7bece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5861:1875455747634688:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574258.259123:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfbee600 going to sleep for 11 seconds 00000100:00100000:1.0:1788574258.268236:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.268323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727721728 00000100:00100000:3.0:1788574258.268339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727721728 00010000:00010000:3.0:1788574258.268412:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 48 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574258.268469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:3.0:1788574258.268479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:2356:x1875455727721728:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574258.268494:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574258.268501:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 48 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.268526:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 48 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.268550:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574258.268555:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.268564:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.268572:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.268592:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574258.268645:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+48:2356:x1875455727721728:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 167us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.268652:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00010000:00010000:0.0:1788574258.270717:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b53667e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a99 expref: 47 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.270749:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7bece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5861:1875455747634688:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574258.270777:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.270800:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.270806:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574258.270947:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788574258.271180:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788574258.271332:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7bece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747634816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788574258.272637:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574258.272685:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79016e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574258.272866:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747634816 00000100:00100000:3.0:1788574258.272877:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747634816 00000100:00100000:3.0:1788574258.272957:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574258.272969:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5861:x1875455747634816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788574258.273090:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5861:x1875455747634816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 124us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.273097:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788574258.273162:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574258.273234:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7bece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747634816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788574258.273772:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788574258.273865:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7bece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747634944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788574258.273912:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574258.273940:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a787d10480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574258.274320:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747634944 00000100:00100000:3.0:1788574258.274326:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747634944 00000100:00100000:3.0:1788574258.274363:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574258.274395:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5861:x1875455747634944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788574258.274589:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5861:x1875455747634944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (675us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788574258.274596:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574258.274680:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7bece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1875455747634944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788574258.274733:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788574258.274779:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.274798:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.274805:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.274811:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574258.274816:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.274824:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.274840:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574258.274843:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788574258.274848:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.274855:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574258.275018:0:5861:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788574258.275117:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788574258.275128:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384449758855ns, next at 385449756920ns, rc = 0 00000001:00080000:1.0:1788574258.275134:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788574258.275164:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574258.275167:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788574258.275175:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3abc expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574258.275285:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7861dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:11570:x1875455727721600:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 20681us (21040us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788574258.275293:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000020:00080000:1.0:1788574258.275298:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788574258.281913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.281999:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727721856 00000100:00100000:0.0:1788574258.282010:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727721856 00000100:00100000:0.0:1788574258.282072:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 203 00000100:00100000:0.0:1788574258.282082:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+50:11570:x1875455727721856:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574258.282106:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.282130:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5366e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3ac3 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.282194:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5366e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ac3 expref: 51 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.282212:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5366e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ac3 expref: 51 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.282233:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.282246:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574258.282251:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4c800, rc 0) 00000100:00100000:0.0:1788574258.282321:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:11570:x1875455727721856:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 231us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.282328:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 203 00000100:00100000:3.0:1788574258.289027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.291588:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727722112 00000100:00100000:2.0:1788574258.291604:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727722112 00000100:00100000:2.0:1788574258.291678:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:2.0:1788574258.291690:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+51:11570:x1875455727722112:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574258.291961:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11570:x1875455727722112:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 272us (2941us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788574258.291968:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:3.0:1788574258.402654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.402758:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727722240 00000100:00100000:0.0:1788574258.402768:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727722240 00000100:00100000:0.0:1788574258.402852:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 204 00000100:00100000:0.0:1788574258.402862:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11580:x1875455727722240:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:0.0:1788574258.402942:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.402972:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.402984:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.402999:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403005:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403011:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403092:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403100:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403105:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574258.403143:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403156:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403163:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403179:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403185:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.403190:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403198:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403213:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574258.403216:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.403220:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403227:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b5366e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403240:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403246:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403252:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403257:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.403260:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403275:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403283:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a78544ff00) 00010000:00010000:0.0:1788574258.403286:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.403289:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403295:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b5366ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403538:0:10109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403545:0:10109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403549:0:10109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403554:0:10109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.403557:0:10109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403562:0:10109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403570:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.403573:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.403575:0:10109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.403590:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b5366f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.403753:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11580:x1875455727722240:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 890us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.403761:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 204 00000100:00100000:3.0:1788574258.469277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.469488:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727722496 00000100:00100000:2.0:1788574258.469500:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727722496 00000100:00100000:2.0:1788574258.469569:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 205 00000100:00100000:2.0:1788574258.469578:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+52:11583:x1875455727722496:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574258.469598:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574258.469618:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5366fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3aca expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469711:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469726:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469738:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469751:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469757:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469763:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469929:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469938:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.469944:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574258.469953:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788574258.470063:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470071:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470085:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470091:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574258.470096:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470103:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470116:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:2.0:1788574258.470119:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574258.470124:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470130:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470144:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470150:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470155:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470159:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574258.470162:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470177:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470186:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a782d70500) 00010000:00010000:2.0:1788574258.470188:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574258.470191:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470197:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53670a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470238:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b5366fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aca expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470252:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aca expref: 54 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.470259:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.470261:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574258.470264:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574258.470349:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11583:x1875455727722496:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 771us (1082us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788574258.470356:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 205 00000100:00100000:3.0:1788574258.476448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.476537:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727722624 00000100:00100000:2.0:1788574258.476546:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727722624 00000100:00100000:2.0:1788574258.476597:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 206 00000100:00100000:2.0:1788574258.476606:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11583:x1875455727722624:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:2.0:1788574258.476701:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476720:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476731:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476756:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476763:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476770:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476776:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574258.476790:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476798:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476810:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.476812:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574258.476818:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.476823:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53671f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574258.476924:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11583:x1875455727722624:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 318us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574258.476931:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 206 00000100:00100000:1.0:1788574258.479597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.479769:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727722880 00000100:00100000:2.0:1788574258.479791:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727722880 00000100:00100000:2.0:1788574258.479869:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:2.0:1788574258.479881:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+54:11583:x1875455727722880:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574258.480194:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:11583:x1875455727722880:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 313us (610us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788574258.480202:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00010000:00010000:0.0:1788574258.496521:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574258.580554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.580979:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727723136 00000100:00100000:0.0:1788574258.580992:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727723136 00000100:00100000:0.0:1788574258.581120:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 207 00000100:00100000:0.0:1788574258.581132:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+55:11594:x1875455727723136:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574258.581163:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.581168:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788574258.581199:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5366a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aae expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.581221:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574258.581228:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574258.581244:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536726 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3ad1 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.582052:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53672d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.582076:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53672d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.582088:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53672d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574258.582120:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788574258.582276:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536726 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad1 expref: 57 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.582294:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53672d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad1 expref: 56 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.582303:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.582391:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574258.582395:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ce00, rc 0) 00000100:00100000:0.0:1788574258.582470:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:11594:x1875455727723136:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1340us (1924us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788574258.582479:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 207 00000100:00100000:3.0:1788574258.585593:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.586880:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727723392 00000100:00100000:2.0:1788574258.586897:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727723392 00000100:00100000:2.0:1788574258.586983:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 208 00000100:00100000:2.0:1788574258.586995:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+56:11594:x1875455727723392:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:2.0:1788574258.587060:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788574258.587089:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b53672d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad1 expref: 56 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.587111:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aca expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.587122:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.587128:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574258.587756:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.587803:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.587815:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574258.587953:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788574258.587988:0:5859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e6c5981 reply state 0000000025437f4b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574258.587997:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574258.588239:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11594:x1875455727723392:12345-192.168.201.57@tcp:36:bash.0 Request processed in 1240us (2651us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788574258.588250:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 208 00000020:00080000:2.0:1788574258.588257:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574258.592137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.592279:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727723520 00000100:00100000:2.0:1788574258.592290:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727723520 00000100:00100000:2.0:1788574258.592356:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:2.0:1788574258.592390:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11594:x1875455727723520:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574258.592420:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574258.592444:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3ad8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.592527:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.592541:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.592560:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.592578:0:5858:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.592591:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592909:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592920:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592927:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592934:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.592938:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592946:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592973:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.592976:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.592979:0:3299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592987:0:3299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.592994:0:3299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.593084:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.593093:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985c00/0x10531a153b53673b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.594080:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.594095:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574258.594144:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788574258.594148:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574258.594170:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.594208:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b536742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.594226:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.594235:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.594238:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574258.594242:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984600, rc 0) 00000100:00100000:2.0:1788574258.594531:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11594:x1875455727723520:12345-192.168.201.57@tcp:101:bash.0 Request processed in 2164us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574258.594552:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:3.0:1788574258.598049:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.598119:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727723776 00000100:00100000:2.0:1788574258.598131:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727723776 00000100:00100000:2.0:1788574258.598201:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:2.0:1788574258.598213:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+57:11594:x1875455727723776:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:2.0:1788574258.598738:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11594:x1875455727723776:12345-192.168.201.57@tcp:35:bash.0 Request processed in 525us (699us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788574258.598746:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:3.0:1788574258.662078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.662208:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727723904 00000100:00100000:0.0:1788574258.662217:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727723904 00000100:00100000:0.0:1788574258.662286:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:0.0:1788574258.662297:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+58:11600:x1875455727723904:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574258.662337:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.662360:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3adf expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.662481:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.662496:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.662528:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574258.662565:0:10109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788574258.662569:0:10109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574258.662587:0:10109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.662613:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c000/0x10531a153b536750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3adf expref: 60 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.662630:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3adf expref: 59 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.662638:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574258.662640:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574258.662644:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4ca00, rc 0) 00000100:00100000:0.0:1788574258.662706:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11600:x1875455727723904:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 411us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.662713:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:1.0:1788574258.667071:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.667173:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727724032 00000100:00100000:0.0:1788574258.667185:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727724032 00000100:00100000:0.0:1788574258.667256:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:0.0:1788574258.667268:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11600:x1875455727724032:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574258.667289:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.667322:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53675e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3ae6 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667470:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667485:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667497:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667512:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667520:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667527:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667621:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667630:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.667986:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574258.668027:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788574258.668031:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574258.668052:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668075:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668084:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668091:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668099:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668105:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.668109:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668116:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668129:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:0.0:1788574258.668133:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.668137:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668143:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ce00/0x10531a153b536765 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668156:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668161:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668173:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668179:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.668182:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668188:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668196:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a78544ff00) 00010000:00010000:0.0:1788574258.668198:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.668201:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668207:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53676c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668242:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4cc00/0x10531a153b53675e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 61 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668255:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 60 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.668262:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.668264:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574258.668266:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159400, rc 0) 00000100:00100000:0.0:1788574258.668322:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11600:x1875455727724032:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1057us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.668338:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:3.0:1788574258.672007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.672194:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727724288 00000100:00100000:2.0:1788574258.672205:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727724288 00000100:00100000:2.0:1788574258.672261:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:2.0:1788574258.672271:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11600:x1875455727724288:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574258.672290:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574258.672321:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53677a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3aed expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672466:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672481:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672490:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 61 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672497:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672550:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 61 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672564:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 61 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574258.672577:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747635072:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574258.672695:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.672704:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574258.672714:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747635200:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574258.672739:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574258.677161:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.677249:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727724416 00000100:00100000:0.0:1788574258.677258:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727724416 00010000:00010000:0.0:1788574258.677295:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 62 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.677344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:0.0:1788574258.677353:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:2355:x1875455727724416:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574258.677401:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574258.677408:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 62 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.677422:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 62 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.677445:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.677450:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.677458:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.677464:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574258.677516:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:2355:x1875455727724416:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.677523:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 77 00010000:00010000:2.0:1788574258.679699:0:5858:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.57@tcp) returned -22 from blocking AST (req@00000000ef270292 x1875455747635072) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 61 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.679727:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ae6 expref: 61 pid: 11654 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574258.679758:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747635072:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574258.679785:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747635200:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574258.679816:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.679848:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.679858:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.679868:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574258.681736:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.681846:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727724544 00000100:00100000:3.0:1788574258.681857:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727724544 00010000:00010000:3.0:1788574258.681897:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574258.681944:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:3.0:1788574258.681955:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:2356:x1875455727724544:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574258.681983:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574258.681991:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.682006:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.682028:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984600/0x10531a153b536749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ad8 expref: 61 pid: 5858 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.682042:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574258.682047:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.682057:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.682066:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.682098:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574258.682158:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:2356:x1875455727724544:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 204us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.682166:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00010000:00010000:2.0:1788574258.682286:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.682296:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574258.682325:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788574258.682497:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53677a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.682514:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.682520:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:2.0:1788574258.682523:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574258.682525:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574258.682551:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11600:x1875455727724288:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 10283us (10560us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788574258.682558:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:3.0:1788574258.686041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574258.686204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727724800 00000100:00100000:1.0:1788574258.686213:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727724800 00000100:00100000:1.0:1788574258.686280:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788574258.686292:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11600:x1875455727724800:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:1.0:1788574258.686317:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574258.686344:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4c800/0x10531a153b5366e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ac3 expref: 60 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574258.686362:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574258.686404:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574258.686470:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11600:x1875455727724800:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 180us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574258.686478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788574258.690530:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.690666:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727724928 00000100:00100000:2.0:1788574258.690676:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727724928 00000100:00100000:2.0:1788574258.690749:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:2.0:1788574258.690759:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11600:x1875455727724928:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:2.0:1788574258.690891:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.690909:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.690921:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574258.691190:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788574258.691308:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11600:x1875455727724928:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 549us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574258.691316:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:2.0:1788574258.694281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.694569:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727725056 00000100:00100000:3.0:1788574258.694581:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727725056 00000100:00100000:3.0:1788574258.694751:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00100000:3.0:1788574258.694761:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+59:11600:x1875455727725056:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574258.694803:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574258.694894:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3af4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.694975:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.694988:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.695013:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.695031:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.695049:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574258.695053:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574258.695058:0:5857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.695067:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6600, rc 0) 00000100:00100000:3.0:1788574258.695154:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11600:x1875455727725056:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 394us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.695163:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 214 00000040:00080000:2.0:1788574258.883034:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574258.883045:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574258.883082:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788574258.883088:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574258.883233:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747635328:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574258.883357:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574258.887939:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.888136:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747635328:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574258.888696:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727725184 00000100:00100000:3.0:1788574258.888704:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727725184 00000100:00100000:3.0:1788574258.888760:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:3.0:1788574258.888788:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11601:x1875455727725184:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574258.888827:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574258.888930:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11601:x1875455727725184:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 144us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.888937:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:3.0:1788574258.896137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.896250:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727725312 00000100:00100000:0.0:1788574258.896262:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727725312 00000100:00100000:0.0:1788574258.896323:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:0.0:1788574258.896334:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11601:x1875455727725312:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788574258.896454:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896473:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896488:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896516:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896524:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896531:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896555:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896564:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896570:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574258.896610:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788574258.896628:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574258.896644:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896657:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896663:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896670:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896675:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.896680:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896688:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896700:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:0.0:1788574258.896703:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.896709:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896715:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b53679d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896733:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896740:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896755:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896761:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.896764:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896779:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896788:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff90a78544ff00) 00010000:00010000:0.0:1788574258.896791:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.896801:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896809:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b5367a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896826:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896832:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896838:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896843:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574258.896846:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896864:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896872:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:0.0:1788574258.896874:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574258.896876:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.896882:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b5367ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.896988:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11601:x1875455727725312:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 638us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.896997:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:1.0:1788574258.905950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.908036:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727725568 00000100:00100000:3.0:1788574258.908061:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727725568 00000100:00100000:3.0:1788574258.908149:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:3.0:1788574258.908160:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+60:11601:x1875455727725568:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574258.908189:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574258.908219:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3afb expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.908346:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.908363:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909065:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574258.909090:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788574258.909241:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909250:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909279:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909285:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574258.909289:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909297:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909311:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574258.909314:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574258.909320:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909326:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909945:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3afb expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909961:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574258.909964:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574258.909969:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3afb expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.909984:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7200, rc 0) 00000100:00100000:3.0:1788574258.910159:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11601:x1875455727725568:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1998us (4219us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788574258.910184:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:2.0:1788574258.913244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.913316:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727725696 00000100:00100000:3.0:1788574258.913337:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727725696 00000100:00100000:3.0:1788574258.913424:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:3.0:1788574258.913445:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11601:x1875455727725696:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574258.913484:0:5859:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574258.914226:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11601:x1875455727725696:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 787us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.914237:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:1.0:1788574258.919145:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.919280:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727725952 00000100:00100000:3.0:1788574258.919290:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727725952 00000100:00100000:3.0:1788574258.919674:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:3.0:1788574258.919686:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11601:x1875455727725952:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574258.919709:0:10109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574258.919712:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574258.919739:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4ca00/0x10531a153b536757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3adf expref: 61 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.919759:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574258.919764:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574258.919788:0:10109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b02 expref: -99 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574258.920293:0:10109:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788574258.920618:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.920648:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.920659:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.920728:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b02 expref: 63 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.920745:0:10109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b02 expref: 62 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.920753:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574258.920756:0:10109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574258.920759:0:10109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6000, rc 0) 00000100:00100000:3.0:1788574258.920840:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11601:x1875455727725952:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1157us (1709us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788574258.920850:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:1.0:1788574258.925893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.925992:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727726208 00000100:00100000:3.0:1788574258.926004:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727726208 00000100:00100000:3.0:1788574258.926116:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:3.0:1788574258.926130:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11601:x1875455727726208:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574258.926194:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574258.926225:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b02 expref: 62 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926246:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574258.926273:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574258.926310:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926325:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926337:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926352:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926359:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926365:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926477:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926485:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926491:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926497:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574258.926502:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926510:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926531:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574258.926533:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574258.926537:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926544:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b5367dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926553:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926559:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926565:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926570:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574258.926573:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926578:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926586:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9da87d99 (ffff90a784e37600) 00010000:00010000:3.0:1788574258.926588:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574258.926591:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.926596:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b5367e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9da87d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574258.926678:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11601:x1875455727726208:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 551us (795us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574258.926685:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:0.0:1788574258.929970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.930052:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727726336 00000100:00100000:3.0:1788574258.930062:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727726336 00000100:00100000:3.0:1788574258.930124:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 221 00000100:00100000:3.0:1788574258.930136:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+61:11601:x1875455727726336:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574258.930163:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574258.930189:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b09 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.930238:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.930256:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.930270:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.930448:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b5367ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 63 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.930470:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 62 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.930482:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:3.0:1788574258.930491:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574258.930497:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7000, rc 0) 00000100:00100000:3.0:1788574258.930580:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11601:x1875455727726336:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 446us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574258.930588:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 221 00000100:00100000:1.0:1788574258.933765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.934045:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727726592 00000100:00100000:3.0:1788574258.934062:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727726592 00000100:00100000:3.0:1788574258.934139:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:3.0:1788574258.934150:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+62:11601:x1875455727726592:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574258.934260:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.934277:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.934289:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574258.935027:0:10109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788574258.935043:0:10109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385109673472ns, next at 386109669411ns, rc = 0 00000004:00010000:3.0:1788574258.935154:0:10109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003293429b reply state 00000000ac7abd37 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574258.935165:0:10109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574258.935530:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+64:11601:x1875455727726592:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1377us (1770us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788574258.935539:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:1.0:1788574258.948597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.948859:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727726720 00000100:00100000:0.0:1788574258.948871:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727726720 00000100:00100000:0.0:1788574258.948938:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 223 00000100:00100000:0.0:1788574258.948950:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+64:11601:x1875455727726720:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574258.948981:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.949009:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b10 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.949076:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 65 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.949090:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 65 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.949135:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:0.0:1788574258.949138:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574258.949143:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159200, rc 0) 00000100:00100000:0.0:1788574258.949200:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+65:11601:x1875455727726720:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 252us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.949207:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 223 00010000:00010000:3.0:1788574258.949666:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.949688:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.949696:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.949701:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574258.949706:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.949713:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.949725:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:3.0:1788574258.949728:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574258.949732:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574258.949739:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6000/0x10531a153b5367f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574258.953129:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574258.953215:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727726848 00000100:00100000:3.0:1788574258.953226:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727726848 00000100:00080000:0.0:1788574258.953385:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574258.953483:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:3.0:1788574258.953497:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79106f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2355:x1875455727726848:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788574258.953835:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79106f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2355:x1875455727726848:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 340us (716us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788574258.962598:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:1.0:1788574258.963088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.963169:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727727104 00000100:00100000:0.0:1788574258.963178:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727727104 00000100:00100000:0.0:1788574258.963227:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:0.0:1788574258.963237:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+64:11601:x1875455727727104:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574258.963666:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+65:11601:x1875455727727104:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 428us (578us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788574258.963674:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:0.0:1788574258.971751:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.971856:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727727360 00000100:00100000:2.0:1788574258.971867:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727727360 00000100:00100000:2.0:1788574258.971965:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 224 00000100:00100000:2.0:1788574258.971977:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+65:11601:x1875455727727360:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574258.972123:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+65:11601:x1875455727727360:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574258.972130:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 224 00000100:00100000:3.0:1788574258.981103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574258.989899:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727727488 00000100:00100000:0.0:1788574258.989913:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727727488 00000100:00100000:0.0:1788574258.989993:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 225 00000100:00100000:0.0:1788574258.990003:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+65:11601:x1875455727727488:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574258.990023:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574258.990043:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158200/0x10531a153b536806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b17 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.990110:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159000/0x10531a153b53680d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.990136:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159000/0x10531a153b53680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.990147:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159000/0x10531a153b53680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574258.990183:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574258.990199:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159000/0x10531a153b53680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.990223:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158200/0x10531a153b536806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b17 expref: 67 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.990241:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159000/0x10531a153b53680d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b17 expref: 66 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574258.990249:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:0.0:1788574258.990253:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788574258.990256:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159000, rc 0) 00000100:00100000:0.0:1788574258.990322:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+66:11601:x1875455727727488:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 321us (9231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574258.990329:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 225 00000100:00100000:1.0:1788574258.998497:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574258.998610:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727727616 00000100:00100000:2.0:1788574258.998623:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727727616 00000100:00100000:2.0:1788574258.998699:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:2.0:1788574258.998711:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+10:2356:x1875455727727616:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574258.998732:0:10306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574258.998754:0:10306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b1e expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574258.998793:0:10306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a33, blocks: 0x1 00010000:00010000:2.0:1788574258.998816:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788574258.998820:0:10306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574258.998829:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 11 pid: 10306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.998847:0:10306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 11 pid: 10306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574258.998861:0:10306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985c00, rc 0) 00000100:00100000:2.0:1788574258.998920:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:2356:x1875455727727616:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 211us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574258.998927:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:0.0:1788574259.005872:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.005972:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727727872 00000100:00100000:1.0:1788574259.005983:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727727872 00000100:00100000:1.0:1788574259.006068:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 226 00000100:00100000:1.0:1788574259.006081:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+66:11601:x1875455727727872:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574259.006200:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+66:11601:x1875455727727872:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.006209:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 226 00000100:00080000:0.0:1788574259.006527:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574259.016663:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574259.016782:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728000 00000100:00100000:0.0:1788574259.016794:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728000 00000100:00100000:0.0:1788574259.016852:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:0.0:1788574259.016862:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:11601:x1875455727728000:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574259.016892:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574259.016911:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b25 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.016945:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.016955:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574259.016958:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574259.016963:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 12 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.016997:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.017010:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574259.017023:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6713:1875455747635456:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574259.017165:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a787d10900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574259.022692:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6713:1875455747635456:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574259.022731:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 12 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.022755:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2158200, rc 0) 00000100:00100000:0.0:1788574259.022841:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:11601:x1875455727728000:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 5979us (6187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574259.022849:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:2.0:1788574259.025736:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574259.025848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728128 00000100:00100000:0.0:1788574259.025859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728128 00010000:00010000:0.0:1788574259.025898:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574259.025943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:0.0:1788574259.025952:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+12:2355:x1875455727728128:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574259.025970:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574259.025994:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.026009:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.026032:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292735f0/0x10531a153b536814 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b1e expref: 12 pid: 10306 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.026048:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574259.026052:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574259.026060:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.026071:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.026119:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574259.026133:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5842:1875455747635584:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574259.026215:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a787d10900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574259.030818:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5842:1875455747635584:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788574259.030848:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574259.030955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:2355:x1875455727728128:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 5003us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574259.030966:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788574259.043583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574259.043750:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728256 00000100:00100000:0.0:1788574259.043762:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728256 00002000:00100000:0.0:1788574259.043839:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff90a7bf9a6680 x1875455727728256/t0(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:410/0 lens 504/0 e 0 to 0 dl 1788574270 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788574259.043852:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bf9a6680 with x1875455727728256 ext(0->12) 00002000:00010000:0.0:1788574259.043859:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bf9a6680 00000100:00100000:0.0:1788574259.043898:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:0.0:1788574259.043909:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+11:2356:x1875455727728256:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788574259.045087:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:2356:x1875455727728256:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 1174us (1511us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788574259.045103:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00002000:00100000:1.0:1788574259.045112:0:6718:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff90a7bf9a6680 x1875455727728256/t4294967320(0) o4->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:410/0 lens 504/448 e 0 to 0 dl 1788574270 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788574259.045123:0:6718:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bf9a6680 with x1875455727728256 ext(0->12) 00002000:00010000:1.0:1788574259.045129:0:6718:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bf9a6680 00000100:00100000:2.0:1788574259.053034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574259.053148:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728384 00000100:00100000:3.0:1788574259.053161:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728384 00000100:00100000:3.0:1788574259.053229:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 227 00000100:00100000:3.0:1788574259.053240:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+66:11601:x1875455727728384:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788574259.136440:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:2.0:1788574259.136466:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a79016e180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788574259.136473:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7bbcaba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a79016e780 00000020:00080000:2.0:1788574259.136477:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7bbcab700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a791cb6400 00000004:00080000:2.0:1788574259.136600:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788574259.136662:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788574259.136681:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a79e7f8480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788574259.136685:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7a7ac9600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a79e7f80c0 00000020:00080000:2.0:1788574259.136687:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7a7ac9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a7bf97e400 00000004:00080000:2.0:1788574259.136695:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788574259.136722:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788574259.136883:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747635712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788574259.136933:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11601:x1875455727728384:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 83691us (83909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574259.136939:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.136946:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 227 00000100:00100000:2.0:1788574259.137022:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747635840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788574259.137045:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574259.137076:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747635712 00000100:00100000:2.0:1788574259.137083:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747635712 00000100:00080000:1.0:1788574259.137120:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574259.137128:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747635840 00000100:00100000:2.0:1788574259.137131:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747635840 00000020:00080000:3.0:1788574259.137357:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788574259.138429:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788574259.138781:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574259.138795:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747635712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788574259.138821:0:12090:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788574259.138848:0:12090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.138889:0:12090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 12 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.138897:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788574259.138902:0:12090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574259.138907:0:12090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.138933:0:12090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 12 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.138948:0:12090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 12 pid: 10306 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574259.138963:0:12090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12090:1875455747636096:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574259.139094:0:12090:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574259.140104:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574259.140121:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875455747635840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788574259.140307:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788574259.140311:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788574259 00002000:00010000:1.0:1788574259.140313:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788574259.140315:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788574259 -> 1788574259 00002000:00010000:1.0:1788574259.140318:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788574259.140393:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1875455747635840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 279us (3346us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788574259.140397:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747635968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788574259.140400:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574259.140437:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.140469:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747635968 00000100:00100000:1.0:1788574259.140477:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747635968 00000100:00100000:1.0:1788574259.140515:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788574259.140523:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747635968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788574259.140538:0:6713:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788574259.140563:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b7a32, atime: 0x6a9b7a32, ctime: 0x6a9b7a32, blocks: 0x1 00010000:00010000:1.0:1788574259.140569:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.140582:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1788574259.140586:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574259.140591:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.140618:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.140628:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.140782:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.140803:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788574259.141285:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1875455747635968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 761us (845us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788574259.141293:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788574259.141322:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574259.141329:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.141338:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574259.141343:0:6727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.141355:0:6727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.141406:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.141415:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536829 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.141437:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574259.141445:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574259.141447:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788574259.141488:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a791d05f80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788574259.141495:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747635968:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788574259.144275:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a79e7f5500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788574259.144291:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747635840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788574259.163094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574259.163492:0:12090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12090:1875455747636096:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574259.163533:0:12090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.166111:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728512 00000100:00100000:1.0:1788574259.166129:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728512 00000100:00100000:1.0:1788574259.166269:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:1.0:1788574259.166281:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:2355:x1875455727728512:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788574259.175649:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574259.175684:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728640 00000100:00100000:3.0:1788574259.175693:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728640 00010000:00010000:3.0:1788574259.175732:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 14 pid: 10306 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.175781:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:3.0:1788574259.175792:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b104c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+14:2356:x1875455727728640:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574259.175806:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574259.175812:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 14 pid: 10306 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.175845:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 14 pid: 10306 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.175868:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b5365e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a84 expref: 14 pid: 10306 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.175886:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574259.175891:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574259.175897:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.175906:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.175930:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574259.175977:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b104c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+13:2356:x1875455727728640:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 187us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.175983:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00010000:00010000:3.0:1788574259.176033:0:12090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.176043:0:12090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.176052:0:12090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.176066:0:12090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.176080:0:12090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788574259.176606:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3315:x1875455747635712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37814us (39664us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788574259.176615:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788574259.176974:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574259.176983:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.176993:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574259.176997:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.177007:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.177021:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.177030:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26b70fc/0x10531a153b536822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.177048:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574259.177049:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574259.177059:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788574259.177579:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a79e7f7100/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788574259.177589:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747635712:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788574259.199937:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788574259.199965:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788574259.200171:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727728512:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 33884us (37085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.200184:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:3.0:1788574259.203245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.203466:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727728896 00000100:00100000:1.0:1788574259.203477:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727728896 00000100:00100000:1.0:1788574259.203574:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 228 00000100:00100000:1.0:1788574259.203585:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11601:x1875455727728896:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574259.203652:0:10109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574259.203680:0:10109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159000/0x10531a153b53680d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b17 expref: 20 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.203706:0:10109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:1.0:1788574259.203712:0:10109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574259.203743:0:10109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.203757:0:10109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.203777:0:10109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574259.204020:0:10109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea649f95 reply state 00000000eb767c17 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.204030:0:10109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574259.204137:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:11601:x1875455727728896:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 553us (901us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788574259.204159:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 228 00010000:00010000:0.0:1788574259.208074:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.208093:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.208121:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.208127:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574259.208132:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.208139:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.208157:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:0.0:1788574259.208160:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574259.208165:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.208171:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536830 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.219696:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574259.219907:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727729024 00000100:00100000:2.0:1788574259.219933:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727729024 00000100:00100000:2.0:1788574259.220000:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:2.0:1788574259.220010:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727729024:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788574259.220227:0:10306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788574259.220232:0:10306:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788574259 -> 1788574258 00002000:00010000:2.0:1788574259.220234:0:10306:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788574258 00002000:00010000:2.0:1788574259.220236:0:10306:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788574259 -> 1788574258 00002000:00010000:2.0:1788574259.220238:0:10306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788574259.220314:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2355:x1875455727729024:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 305us (629us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788574259.220322:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:2.0:1788574259.237532:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574259.237666:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727729280 00000100:00100000:0.0:1788574259.237678:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727729280 00000100:00100000:0.0:1788574259.237742:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 229 00000100:00100000:0.0:1788574259.237755:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:11601:x1875455727729280:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788574259.237852:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.237872:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 20 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.237881:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.237934:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 20 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.237948:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 20 pid: 5859 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574259.237962:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747636224:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574259.238069:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a781370c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574259.243194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574259.243285:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727729408 00000100:00100000:3.0:1788574259.243294:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727729408 00010000:00010000:3.0:1788574259.243333:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 21 pid: 5859 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.243416:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:3.0:1788574259.243427:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:2356:x1875455727729408:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574259.243443:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574259.243450:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 21 pid: 5859 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.243463:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 21 pid: 5859 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.243485:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:3.0:1788574259.243490:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.243528:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.243536:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.243557:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574259.243606:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:2356:x1875455727729408:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.243614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00010000:00010000:0.0:1788574259.243938:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7000/0x10531a153b5367f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b09 expref: 20 pid: 5859 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574259.243955:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747636224:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574259.243977:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.243986:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.243991:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244019:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244026:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244032:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244045:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574259.244049:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244056:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244065:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:0.0:1788574259.244068:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788574259.244071:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.244076:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159c00/0x10531a153b536837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574259.244135:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:11601:x1875455727729280:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 6383us (6613us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788574259.244142:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 229 00000100:00100000:1.0:1788574259.253986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574259.254071:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727729536 00000100:00100000:3.0:1788574259.254082:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727729536 00000100:00100000:3.0:1788574259.254148:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:3.0:1788574259.254158:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727729536:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788574259.254204:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.254226:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 8 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.254234:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574259.254239:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574259.254244:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.254279:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 8 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.254324:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 8 pid: 6713 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.254340:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6712:1875455747636352:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574259.254466:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574259.269639:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6712:1875455747636352:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574259.269670:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.271647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574259.272060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727729664 00000100:00100000:2.0:1788574259.272075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727729664 00010000:00010000:2.0:1788574259.272128:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 9 pid: 6713 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574259.272169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:2.0:1788574259.272178:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+9:2356:x1875455727729664:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574259.272194:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574259.272221:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 9 pid: 6713 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.272236:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 9 pid: 6713 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.272285:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060581418/0x10531a153b53681b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b25 expref: 9 pid: 6713 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.272315:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574259.272320:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574259.272327:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.272337:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.272414:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574259.272470:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727729664:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 292us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574259.272478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00010000:00010000:1.0:1788574259.273899:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.273920:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.273957:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.273966:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.273975:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.273982:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574259.273987:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.273997:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.274036:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.274045:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018128b84/0x10531a153b53683e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.274144:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727729536:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 19983us (20164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.274152:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:1.0:1788574259.285083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574259.285190:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727729920 00000100:00100000:3.0:1788574259.285205:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727729920 00000100:00100000:3.0:1788574259.285270:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:3.0:1788574259.285282:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:11601:x1875455727729920:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788574259.285417:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285436:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285448:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285785:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285798:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285824:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285859:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.285875:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 20 pid: 5857 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.285891:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747636480:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574259.285979:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574259.289166:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574259.291283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727730048 00000100:00100000:2.0:1788574259.291310:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727730048 00010000:00010000:2.0:1788574259.291424:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 21 pid: 5857 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574259.291472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:2.0:1788574259.291482:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:2356:x1875455727730048:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574259.291500:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574259.291508:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 21 pid: 5857 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.291543:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 21 pid: 5857 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.291571:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:2.0:1788574259.291577:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.291587:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.291595:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574259.291617:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574259.291938:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:2356:x1875455727730048:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 456us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574259.291947:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00010000:00010000:1.0:1788574259.293473:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159200/0x10531a153b5367ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b10 expref: 20 pid: 5857 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.293599:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747636480:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574259.293629:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.293640:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.293646:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574259.293855:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788574259.294011:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788574259.294057:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788574259.294146:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747636608:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788574259.294228:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.294495:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78524ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574259.299545:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747636608 00000100:00100000:3.0:1788574259.299565:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747636608 00000100:00100000:3.0:1788574259.299647:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574259.299658:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747636608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574259.299837:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747636608:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.299846:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574259.299896:0:5858:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788574259.299902:0:5858:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788574259.299922:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a79e7f5500, transno 4294967321 00000100:00100000:2.0:1788574259.299941:0:5858:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90a79e7f7100 x1875455747635712/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788574275 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574259.299953:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747636608:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788574259.300447:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788574259.300526:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747636736:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788574259.300572:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574259.300621:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574259.300637:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747636736 00000100:00100000:3.0:1788574259.300643:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747636736 00000100:00100000:3.0:1788574259.300677:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574259.300686:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1875455747636736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574259.304410:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5858:x1875455747636736:12345-0@lo:1000:mdt00_001.0 Request processed in 3713us (3825us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788574259.304426:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574259.305403:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5858:1875455747636736:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788574259.305457:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305468:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305476:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305483:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574259.305487:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305496:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305607:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37e00) 00010000:00010000:1.0:1788574259.305611:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574259.305617:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305625:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7200/0x10531a153b53684c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305663:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305669:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305689:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305695:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574259.305698:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305704:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305714:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574259.305717:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574259.305725:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305737:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305747:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.305801:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.305819:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747636864:192.168.201.57@tcp:105: 00000100:00100000:1.0:1788574259.305929:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ed7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574259.312880:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1875455747636864:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788574259.312945:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.312958:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b53678f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313002:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313020:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313035:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313046:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313054:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313060:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313066:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574259.313072:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313079:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313091:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574259.313095:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574259.313107:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313114:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536853 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313126:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313133:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313139:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313144:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574259.313147:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313153:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313161:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574259.313164:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788574259.313167:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.313173:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6a00/0x10531a153b536845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.313454:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:11601:x1875455727729920:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 28171us (28380us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788574259.313465:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 230 00000020:00080000:1.0:1788574259.313478:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788574259.314054:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574259.314060:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574259.315034:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788574259.315072:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574259.327499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.327644:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727730176 00000100:00100000:1.0:1788574259.327657:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727730176 00000100:00100000:1.0:1788574259.327731:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788574259.327743:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:11600:x1875455727730176:12345-192.168.201.57@tcp:49:lfs.0 00000100:00100000:1.0:1788574259.327904:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:11600:x1875455727730176:12345-192.168.201.57@tcp:49:lfs.0 Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.327912:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:3.0:1788574259.328102:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.328195:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727730432 00000100:00100000:1.0:1788574259.328200:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727730432 00000100:00100000:1.0:1788574259.328236:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:1.0:1788574259.328244:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7861dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+23:11601:x1875455727730432:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788574259.328998:0:5861:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788574259.329111:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788574259.329161:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.329177:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.329190:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.329199:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.329205:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.329212:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.329226:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574259.329406:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574259.329413:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.329421:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574259.329425:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.329433:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.329445:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574259.329454:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788574259.329461:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.329468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b53685a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.329485:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574259.329487:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574259.329488:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574259.329697:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747637376:0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.329743:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.329785:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574259.329792:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747637248:0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.329818:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.329850:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747637376 00000100:00100000:1.0:1788574259.329856:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747637376 00000100:00100000:1.0:1788574259.329898:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747637248 00000100:00100000:1.0:1788574259.329902:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747637248 00000100:00100000:1.0:1788574259.329924:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788574259.329932:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747637376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.329970:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747637376:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.329977:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788574259.329991:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788574259.330005:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747637248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574259.330008:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747637120:0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.330032:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747637248:12345-0@lo:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574259.330034:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.330038:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788574259.330048:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747637120 00000100:00100000:1.0:1788574259.330051:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747637120 00000100:00100000:0.0:1788574259.330051:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574259.330056:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747636992:0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.330064:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788574259.330069:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747637120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574259.330081:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574259.330091:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747637120:12345-0@lo:400:kworker.0 Request processed in 22us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.330096:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788574259.330110:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747636992 00000100:00100000:1.0:1788574259.330113:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747636992 00000100:00100000:0.0:1788574259.330117:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747637120:0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.330134:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788574259.330140:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.330180:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747636992:12345-0@lo:400:kworker.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.330187:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1788574259.330213:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574259.330236:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747637248:0@lo:400:kworker.0 00000100:00100000:1.0:1788574259.330246:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747637376:0@lo:400:kworker.0 00000100:00100000:0.0:1788574259.330861:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747636992:0@lo:400:kworker.0 00000100:00100000:3.0:1788574259.333002:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7861dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+25:11601:x1875455727730432:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 1057us (1199us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788574259.333039:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000020:00080000:3.0:1788574259.333053:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788574259.334846:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.334933:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727730688 00000100:00100000:1.0:1788574259.334946:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727730688 00000100:00100000:1.0:1788574259.335014:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 231 00000100:00100000:1.0:1788574259.335026:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+25:11600:x1875455727730688:12345-192.168.201.57@tcp:58:lfs.0 00000040:00080000:1.0:1788574259.335307:0:10109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788574259.335426:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+25:11600:x1875455727730688:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 401us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.335434:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 231 00000100:00100000:2.0:1788574259.410471:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.410561:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727730816 00000100:00100000:1.0:1788574259.410572:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727730816 00000100:00100000:1.0:1788574259.410653:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:1.0:1788574259.410664:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+25:11603:x1875455727730816:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574259.410697:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574259.410723:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b2c expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.410829:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.410845:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.410857:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.410874:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.410880:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.410885:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.411188:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.411210:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 26 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.411220:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.411260:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 26 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.411274:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 26 pid: 5858 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574259.411288:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e8eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747637504:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574259.411445:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ed7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574259.416787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574259.416938:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727731072 00000100:00100000:2.0:1788574259.416948:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727731072 00000100:00100000:2.0:1788574259.417014:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:2.0:1788574259.417025:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:5592:x1875455727731072:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788574259.417355:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:5592:x1875455727731072:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 331us (578us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788574259.417364:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:2.0:1788574259.419689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574259.419896:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e8eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11654:1875455747637504:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574259.419930:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.420588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727731200 00000100:00100000:3.0:1788574259.420598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727731200 00010000:00010000:3.0:1788574259.420648:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 28 pid: 5858 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574259.420692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:3.0:1788574259.420719:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:2355:x1875455727731200:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574259.420735:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574259.420742:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 28 pid: 5858 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.420755:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 28 pid: 5858 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.420788:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536781 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3aed expref: 28 pid: 5858 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.420805:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574259.420810:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.420820:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.420828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.420856:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574259.420916:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:2355:x1875455727731200:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 198us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.420923:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00010000:00010000:1.0:1788574259.421699:0:11654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421713:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574259.421787:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788574259.421791:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574259.421811:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421844:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421853:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421860:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421867:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421873:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574259.421877:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421885:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421898:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:1.0:1788574259.421901:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574259.421905:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421913:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21600/0x10531a153b536868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421928:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421934:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421945:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421949:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574259.421952:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421957:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421965:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90a7b2398300) 00010000:00010000:1.0:1788574259.421967:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574259.421970:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.421975:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b53686f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.422024:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b2c expref: 27 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.422040:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b2c expref: 26 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.422047:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574259.422049:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574259.422051:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574259.422105:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11603:x1875455727730816:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 11443us (11648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574259.422122:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 232 00010000:00010000:3.0:1788574259.521399:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574259.840639:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574259.840668:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747637632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574259.840748:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574259.841076:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747637632 00000100:00100000:3.0:1788574259.841086:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747637632 00000100:00100000:3.0:1788574259.841153:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574259.841184:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3315:x1875455747637632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574259.841238:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574259.841316:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3315:x1875455747637632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.841324:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574259.841431:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747637632:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788574259.941904:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788574259.947112:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:2.0:1788574260.382406:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574260.382417:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574260.382454:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788574260.382479:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574260.382641:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747637760:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574260.388736:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574260.389034:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11709:1875455747637760:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788574260.403477:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574260.403545:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727731328 00000100:00100000:1.0:1788574260.403556:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727731328 00000100:00100000:1.0:1788574260.403628:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 233 00000100:00100000:1.0:1788574260.403638:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11615:x1875455727731328:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788574260.403676:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788574260.406520:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11615:x1875455727731328:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 2871us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574260.406534:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 233 00000100:00100000:0.0:1788574260.410859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574260.411557:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727731584 00000100:00100000:3.0:1788574260.411571:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727731584 00000100:00100000:3.0:1788574260.411632:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 234 00000100:00100000:3.0:1788574260.411643:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+26:11615:x1875455727731584:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574260.411665:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574260.411688:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53687d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b33 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.411799:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.411814:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.411827:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574260.411838:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788574260.411970:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b53687d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b33 expref: 29 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.412005:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b33 expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.412014:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574260.412017:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574260.412022:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574260.412091:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:11615:x1875455727731584:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 451us (1242us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788574260.412099:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 234 00000100:00100000:3.0:1788574260.417768:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574260.417882:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727731712 00000100:00100000:1.0:1788574260.417893:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727731712 00000100:00100000:1.0:1788574260.417972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:1.0:1788574260.417984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:2356:x1875455727731712:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574260.418003:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574260.418037:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b33 expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.418059:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574260.418065:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574260.418125:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:2356:x1875455727731712:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 142us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574260.418148:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788574260.425681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574260.425768:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727731968 00000100:00100000:3.0:1788574260.425779:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727731968 00000100:00100000:3.0:1788574260.428486:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 235 00000100:00100000:3.0:1788574260.428510:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+27:11615:x1875455727731968:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788574260.428622:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428641:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428653:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428892:0:11654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428901:0:11654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428914:0:11654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428920:0:11654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574260.428924:0:11654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428932:0:11654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428943:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574260.428946:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574260.428951:0:11654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574260.428958:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574260.429145:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:11615:x1875455727731968:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 644us (3471us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788574260.429154:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 235 00000040:00080000:2.0:1788574260.429864:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574260.429870:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574260.430344:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788574260.430363:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788574260.445422:0:12537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574260.445432:0:12537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574260.445479:0:12537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788574260.445493:0:12537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574260.451417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574260.451453:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727732224 00000100:00100000:3.0:1788574260.451462:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727732224 00000100:00100000:3.0:1788574260.451524:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:3.0:1788574260.451535:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+28:11615:x1875455727732224:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788574260.452104:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:11615:x1875455727732224:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 568us (695us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788574260.452130:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00010000:00010000:1.0:1788574260.561771:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574260.706977:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574260.708778:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727732480 00000100:00100000:1.0:1788574260.708793:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727732480 00000100:00100000:1.0:1788574260.708864:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 236 00000100:00100000:1.0:1788574260.708875:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+29:11628:x1875455727732480:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788574260.708899:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574260.708920:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09600/0x10531a153b536899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b3a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.709010:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb08200/0x10531a153b5368a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.709031:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb08200/0x10531a153b5368a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.709043:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb08200/0x10531a153b5368a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574260.709054:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788574260.709181:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09600/0x10531a153b536899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b3a expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.709199:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb08200/0x10531a153b5368a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b3a expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.709225:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574260.709227:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788574260.709231:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfb08200, rc 0) 00000100:00100000:1.0:1788574260.709308:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:11628:x1875455727732480:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 435us (2342us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788574260.709315:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 236 00000100:00100000:2.0:1788574260.714396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574260.714839:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727732608 00000100:00100000:1.0:1788574260.714849:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727732608 00000100:00100000:1.0:1788574260.714916:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 237 00000100:00100000:1.0:1788574260.714927:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:11628:x1875455727732608:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788574260.714999:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715017:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715029:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715055:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715062:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715068:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715074:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574260.715094:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715102:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715115:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:1.0:1788574260.715117:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574260.715122:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.715128:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb09000/0x10531a153b5368ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574260.715207:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:11628:x1875455727732608:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 281us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574260.715215:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 237 00000100:00100000:0.0:1788574260.870607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574260.870854:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727732736 00000100:00100000:1.0:1788574260.870865:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727732736 00000100:00100000:1.0:1788574260.870941:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:1.0:1788574260.870954:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2356:x1875455727732736:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:1.0:1788574260.870972:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574260.870994:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b5368b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b41 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574260.871021:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b7a32, atime: 0x6a9b7a32, ctime: 0x6a9b7a32, blocks: 0xb 00010000:00010000:1.0:1788574260.871043:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1788574260.871047:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574260.871057:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b5368b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b41 expref: 8 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.871092:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b5368b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b41 expref: 8 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574260.871106:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfb09000, rc 0) 00000100:00100000:1.0:1788574260.871183:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727732736:12345-192.168.201.57@tcp:101:cat.0 Request processed in 233us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574260.871189:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00080000:2.0:1788574260.871312:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574260.887176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574260.887304:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727732864 00000100:00100000:2.0:1788574260.887316:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727732864 00002000:00100000:2.0:1788574260.887420:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff90a7bf9a7b80 x1875455727732864/t0(0) o3->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:411/0 lens 488/0 e 0 to 0 dl 1788574271 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574260.887432:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bf9a7b80 with x1875455727732864 ext(0->4095) 00002000:00010000:2.0:1788574260.887440:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bf9a7b80 00000100:00100000:2.0:1788574260.887482:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574260.887492:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2354:x1875455727732864:12345-192.168.201.57@tcp:3:cat.0 00000100:00100000:2.0:1788574260.887896:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2354:x1875455727732864:12345-192.168.201.57@tcp:3:cat.0 Request processed in 403us (732us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788574260.887903:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00002000:00100000:2.0:1788574260.887910:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff90a7bf9a7b80 x1875455727732864/t0(0) o3->f540d78c-33c0-4206-a4f5-51879daa7a3f@192.168.201.57@tcp:411/0 lens 488/4536 e 0 to 0 dl 1788574271 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574260.887918:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7bf9a7b80 with x1875455727732864 ext(0->4095) 00002000:00010000:2.0:1788574260.887922:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a7bf9a7b80 00010000:00010000:0.0:1788574261.568619:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574262.407737:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747637888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574262.407819:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574262.407906:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747637888 00000100:00100000:2.0:1788574262.407917:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747637888 00000100:00100000:2.0:1788574262.407976:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574262.407986:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747637888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574262.408032:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574262.408095:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747637888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574262.408120:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788574262.408144:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574262.408189:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747637888:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788574262.469603:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574262.469614:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574262.469648:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788574262.469675:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788574262.592684:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574263.087168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574263.087204:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574263.087249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574263.087287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574263.087332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574263.087394:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727733504 00000100:00100000:0.0:1788574263.087418:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727733504 00000100:00100000:0.0:1788574263.087487:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727733120 00000100:00100000:0.0:1788574263.087491:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727733120 00000100:00100000:0.0:1788574263.087529:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 165 00000100:00100000:0.0:1788574263.087550:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727733504:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574263.087624:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2356:x1875455727733504:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 77us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574263.087631:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 165 00000100:00100000:0.0:1788574263.087648:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:0.0:1788574263.087653:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:2356:x1875455727733120:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574263.087678:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+31:2356:x1875455727733120:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574263.087684:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:0.0:1788574263.087735:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727733248 00000100:00100000:0.0:1788574263.087740:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727733248 00000100:00100000:0.0:1788574263.087767:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727733376 00000100:00100000:0.0:1788574263.087771:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727733376 00000100:00100000:0.0:1788574263.087794:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:0.0:1788574263.087800:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727733248:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574263.087830:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+8:2356:x1875455727733248:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574263.087836:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:0.0:1788574263.087848:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:0.0:1788574263.087854:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727733376:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574263.087876:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2356:x1875455727733376:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 22us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574263.087889:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:3.0:1788574263.088565:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727732992 00000100:00100000:3.0:1788574263.088574:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727732992 00000100:00100000:3.0:1788574263.088616:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 302 00000100:00100000:3.0:1788574263.088624:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727732992:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574263.088659:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727732992:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 36us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574263.088665:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 302 00000100:00080000:2.0:1788574263.089202:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574263.089208:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574263.089212:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574263.616862:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574264.452200:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747638016:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452289:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.452341:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747638528:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.452420:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788574264.452426:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747638144:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452447:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.452463:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747638656:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452486:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.452517:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747638272:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452567:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.452585:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574264.452593:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747638400:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452625:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.452659:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638016 00000100:00100000:1.0:1788574264.452808:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638016 00000100:00100000:1.0:1788574264.452863:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788574264.452873:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747638016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.452930:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747638016:12345-0@lo:400:kworker.0 Request processed in 59us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574264.452937:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788574264.452979:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638528 00000100:00100000:1.0:1788574264.452984:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638528 00000100:00100000:1.0:1788574264.453027:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638144 00000100:00100000:1.0:1788574264.453031:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638144 00000100:00100000:1.0:1788574264.453048:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638272 00000100:00100000:1.0:1788574264.453050:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638272 00000100:00100000:1.0:1788574264.453063:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788574264.453069:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747638528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453100:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747638528:12345-0@lo:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574264.453106:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788574264.453117:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788574264.453123:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747638144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453149:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747638144:12345-0@lo:400:kworker.0 Request processed in 26us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574264.453154:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788574264.453165:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788574264.453171:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747638272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453203:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747638272:12345-0@lo:400:kworker.0 Request processed in 32us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574264.453208:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788574264.453238:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638656 00000100:00100000:1.0:1788574264.453242:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638656 00000100:00100000:1.0:1788574264.453263:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638400 00000100:00100000:1.0:1788574264.453266:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638400 00000100:00100000:1.0:1788574264.453283:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788574264.453289:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747638656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453320:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747638656:12345-0@lo:400:kworker.0 Request processed in 31us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574264.453326:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788574264.453336:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788574264.453342:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875455747638400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453388:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875455747638400:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574264.453394:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788574264.453411:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574264.453415:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574264.453418:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574264.453456:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747638400:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453468:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747638272:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453496:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747638144:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453505:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788574264.453509:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a79b051880, transno 4294967307 00000004:00080000:1.0:1788574264.453523:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788574264.453535:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a791d05f80, transno 4294967310 00000100:00100000:1.0:1788574264.453972:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747638656:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.453994:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747638016:0@lo:400:kworker.0 00000100:00100000:1.0:1788574264.454019:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747638528:0@lo:400:kworker.0 00000001:00080000:1.0:1788574264.540466:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788574264.540485:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788574264.540855:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788574264.540894:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a79e7f8d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788574264.540899:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7a7ac9000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a79e7f80c0 00000020:00080000:0.0:1788574264.540903:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7a7ac9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a7a76f8c00 00000020:00080000:0.0:1788574264.540935:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788574264.541759:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788574264.541962:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788574264.640505:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574264.970712:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574264.970733:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747638784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574264.970800:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574264.970876:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638784 00000100:00100000:3.0:1788574264.970886:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638784 00000100:00100000:3.0:1788574264.970938:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788574264.970948:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747638784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574264.970985:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574264.971031:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747638784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574264.971038:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788574264.971083:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747638784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788574265.664601:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574266.154737:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574266.156925:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727733632 00000100:00100000:1.0:1788574266.156946:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727733632 00000100:00100000:1.0:1788574266.157056:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 238 00000100:00100000:1.0:1788574266.157071:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11287:x1875455727733632:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788574266.157208:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11287:x1875455727733632:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 Request processed in 142us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574266.157216:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 238 00000100:00080000:2.0:1788574266.160922:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574266.175714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574266.175808:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727733888 00000100:00100000:3.0:1788574266.175833:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727733888 00000100:00100000:3.0:1788574266.175900:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:3.0:1788574266.175912:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:11287:x1875455727733888:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788574266.176938:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:11287:x1875455727733888:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 1024us (1230us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788574266.176947:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:1.0:1788574266.529504:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574266.529920:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734016 00000100:00100000:2.0:1788574266.529934:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734016 00000100:00100000:2.0:1788574266.530146:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 239 00000100:00100000:2.0:1788574266.530158:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:12080:x1875455727734016:12345-192.168.201.57@tcp:101:lsof.0 00010000:00010000:2.0:1788574266.530182:0:11654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574266.530208:0:11654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5368bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b48 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574266.530288:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5368c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574266.530305:0:11654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5368c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574266.530321:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5368c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574266.530418:0:11654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788574266.530422:0:11654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574266.530452:0:11654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5368c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574266.530480:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985400/0x10531a153b5368bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b48 expref: 7 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574266.530502:0:11654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5368c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b48 expref: 6 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574266.530512:0:11654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:2.0:1788574266.530515:0:11654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574266.530519:0:11654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984a00, rc 0) 00000100:00100000:2.0:1788574266.531132:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:12080:x1875455727734016:12345-192.168.201.57@tcp:101:lsof.0 Request processed in 968us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574266.531143:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 239 00000100:00080000:1.0:1788574266.531514:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574266.689181:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574267.523099:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574267.523133:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747638912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574267.523224:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.523351:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747638912 00000100:00100000:2.0:1788574267.523361:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747638912 00000100:00100000:2.0:1788574267.523451:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788574267.523463:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747638912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574267.523504:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574267.523553:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747638912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574267.523560:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788574267.524105:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574267.524169:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788574267.524177:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a79e7f7100, transno 4294967322 00000004:00080000:0.0:1788574267.524194:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788574267.524223:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747638912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574267.713028:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574268.213759:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574268.213803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574268.213822:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734272 00000100:00100000:3.0:1788574268.213834:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734272 00000100:00100000:0.0:1788574268.213839:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574268.213907:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00100000:3.0:1788574268.213918:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:2354:x1875455727734272:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574268.213935:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734528 00000100:00100000:2.0:1788574268.213941:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734528 00000100:00100000:2.0:1788574268.214002:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:3.0:1788574268.214008:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:2354:x1875455727734272:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574268.214014:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727734528:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574268.214021:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00080000:3.0:1788574268.214046:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574268.214052:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574268.214056:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2354:x1875455727734528:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 45us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574268.214063:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:1.0:1788574268.214235:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734144 00000100:00100000:1.0:1788574268.214240:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734144 00000100:00100000:1.0:1788574268.214278:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 304 00000100:00100000:1.0:1788574268.214286:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727734144:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574268.214315:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2354:x1875455727734144:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574268.214321:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 304 00000100:00100000:2.0:1788574268.215357:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574268.215423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574268.215542:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734656 00000100:00100000:3.0:1788574268.215552:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734656 00000100:00100000:3.0:1788574268.215629:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:3.0:1788574268.215854:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2354:x1875455727734656:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574268.215917:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2354:x1875455727734656:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 280us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574268.215925:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00080000:2.0:1788574268.215998:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574268.217326:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734400 00000100:00100000:1.0:1788574268.217341:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734400 00000100:00100000:1.0:1788574268.217438:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:1.0:1788574268.217450:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727734400:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788574268.217634:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574268.217821:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2354:x1875455727734400:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 372us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574268.217829:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00010000:00010000:2.0:1788574268.737396:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574269.569057:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747639296:0@lo:400:kworker.0 00000100:00100000:0.0:1788574269.569155:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574269.569244:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574269.569251:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574269.569282:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574269.569329:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639424 00000100:00100000:0.0:1788574269.569336:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639424 00000100:00100000:0.0:1788574269.569428:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574269.569438:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747639424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574269.569506:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747639424:12345-0@lo:400:kworker.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574269.569513:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574269.569553:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747639424:0@lo:400:kworker.0 00000100:00100000:2.0:1788574269.569805:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639296 00000100:00100000:2.0:1788574269.569811:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639296 00000100:00100000:2.0:1788574269.569863:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788574269.569871:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747639296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574269.569913:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747639296:12345-0@lo:400:kworker.0 Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574269.569920:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788574269.569936:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574269.569941:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574269.570289:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747639296:0@lo:400:kworker.0 00000100:00100000:1.0:1788574269.571720:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747639040:0@lo:400:kworker.0 00000100:00100000:1.0:1788574269.571791:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574269.571854:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747639552:0@lo:400:kworker.0 00000100:00100000:1.0:1788574269.571884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574269.571906:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788574269.571913:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747639168:0@lo:400:kworker.0 00000100:00100000:1.0:1788574269.571933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574269.571948:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747639680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574269.571970:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574269.573661:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639040 00000100:00100000:2.0:1788574269.573675:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639040 00000100:00100000:2.0:1788574269.573721:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788574269.573731:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747639040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574269.573814:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747639040:12345-0@lo:400:kworker.0 Request processed in 84us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574269.573821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788574269.573884:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747639040:0@lo:400:kworker.0 00000100:00100000:3.0:1788574269.575416:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639680 00000100:00100000:3.0:1788574269.575429:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639680 00000100:00080000:3.0:1788574269.576466:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574269.576488:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639552 00000100:00100000:3.0:1788574269.576495:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639552 00000100:00100000:3.0:1788574269.576550:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639168 00000100:00100000:3.0:1788574269.576554:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639168 00000100:00100000:3.0:1788574269.576577:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788574269.576596:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747639552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574269.576688:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747639552:12345-0@lo:400:kworker.0 Request processed in 102us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574269.576695:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788574269.576712:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788574269.576718:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747639168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574269.576746:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747639168:12345-0@lo:400:kworker.0 Request processed in 28us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574269.576752:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788574269.576766:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574269.576805:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747639168:0@lo:400:kworker.0 00000100:00100000:3.0:1788574269.576819:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747639552:0@lo:400:kworker.0 00000100:00100000:3.0:1788574269.577106:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574269.577114:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747639680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574269.577153:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747639680:12345-0@lo:400:kworker.0 Request processed in 41us (5182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574269.577159:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574269.577187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747639680:0@lo:400:kworker.0 00000020:00080000:0.0:1788574269.698413:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788574269.698456:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788574269.698909:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788574269.698923:0:5890:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788574269.760578:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574270.080614:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574270.080637:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bf9a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747639808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574270.080704:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574270.080839:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639808 00000100:00100000:3.0:1788574270.080848:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639808 00000100:00100000:3.0:1788574270.080900:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788574270.080911:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747639808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574270.080956:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574270.081014:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747639808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574270.081021:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574270.081103:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bf9a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747639808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574270.784638:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574271.099973:0:12737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:11:09 (1788574269) 00010000:00010000:2.0:1788574271.809014:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574272.644056:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfaa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747639936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574272.644177:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574272.644284:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747639936 00000100:00100000:3.0:1788574272.644295:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747639936 00000100:00100000:3.0:1788574272.644391:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788574272.644402:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747639936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574272.644462:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574272.644514:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747639936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574272.644522:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788574272.644558:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574272.644747:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfaa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747639936:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788574272.704852:0:11709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574272.704874:0:11709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574272.705605:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788574272.705646:0:11709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788574272.832686:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574273.333509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574273.333572:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574273.333601:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574273.333624:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574273.333649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574273.333684:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727735040 00000100:00100000:0.0:1788574273.333697:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727735040 00000100:00100000:0.0:1788574273.333764:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727735168 00000100:00100000:0.0:1788574273.333767:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727735168 00000100:00100000:0.0:1788574273.333793:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:0.0:1788574273.333805:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727735040:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574273.333895:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2355:x1875455727735040:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574273.333904:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:0.0:1788574273.333926:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788574273.333933:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727735168:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574273.333983:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2355:x1875455727735168:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574273.333990:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788574273.334010:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727735296 00000100:00100000:0.0:1788574273.334014:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727735296 00000100:00100000:0.0:1788574273.334050:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734912 00000100:00100000:0.0:1788574273.334053:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734912 00000100:00100000:0.0:1788574273.334077:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:0.0:1788574273.334093:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2355:x1875455727735296:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574273.334123:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2355:x1875455727735296:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574273.334130:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:0.0:1788574273.334141:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:0.0:1788574273.334148:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:2355:x1875455727734912:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574273.334171:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:2355:x1875455727734912:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574273.334177:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:3.0:1788574273.334636:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727734784 00000100:00100000:3.0:1788574273.334643:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727734784 00000100:00100000:3.0:1788574273.334683:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 306 00000100:00100000:3.0:1788574273.334692:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727734784:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574273.334733:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec16a69b-cbad-484e-9f31-b00eca338977+13:2355:x1875455727734784:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 43us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574273.334740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 306 00000100:00080000:3.0:1788574273.334779:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574273.334794:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574273.334797:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574273.856715:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574274.688858:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747640192:0@lo:400:kworker.0 00000100:00100000:2.0:1788574274.688990:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574274.689087:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640192 00000100:00100000:2.0:1788574274.689153:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640192 00000100:00100000:3.0:1788574274.689239:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a68214df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747640064:0@lo:400:kworker.0 00000100:00100000:3.0:1788574274.689286:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574274.689293:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788574274.689307:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747640192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574274.689328:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640064 00000100:00100000:3.0:1788574274.689332:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640064 00000100:00100000:3.0:1788574274.689388:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788574274.689396:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747640192:12345-0@lo:400:kworker.0 Request processed in 91us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574274.689399:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747640064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574274.689410:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788574274.689447:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3312:x1875455747640064:12345-0@lo:400:kworker.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574274.689454:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788574274.689471:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747640192:0@lo:400:kworker.0 00000100:00100000:3.0:1788574274.689516:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a68214df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747640064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.691659:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747640320:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.691748:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574274.691809:0:11654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640320 00000100:00100000:0.0:1788574274.691819:0:11654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640320 00000100:00100000:0.0:1788574274.691890:0:11654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788574274.691900:0:11654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747640320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.691961:0:11654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747640320:12345-0@lo:400:kworker.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574274.691989:0:11654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1788574274.692015:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574274.692068:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747640320:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692116:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747640448:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692149:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574274.692184:0:12090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640448 00000100:00100000:0.0:1788574274.692190:0:12090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640448 00000100:00100000:0.0:1788574274.692226:0:12090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788574274.692234:0:12090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747640448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692273:0:12090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747640448:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574274.692281:0:12090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788574274.692301:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574274.692324:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747640448:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692510:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747640576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574274.692577:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640576 00000100:00100000:0.0:1788574274.692580:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640576 00000100:00100000:0.0:1788574274.692608:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788574274.692614:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747640576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692648:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747640576:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574274.692654:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1788574274.692666:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574274.692680:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747640576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747640704:0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692771:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574274.692809:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640704 00000100:00100000:0.0:1788574274.692814:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640704 00000100:00100000:0.0:1788574274.692848:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788574274.692855:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574274.692891:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747640704:12345-0@lo:400:kworker.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574274.692898:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788574274.692914:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574274.692933:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747640704:0@lo:400:kworker.0 00010000:00010000:2.0:1788574274.881042:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574275.200692:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747640832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574275.200830:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574275.201088:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640832 00000100:00100000:2.0:1788574275.201100:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640832 00000100:00100000:2.0:1788574275.201174:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788574275.201186:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747640832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574275.201234:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574275.212673:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747640832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11470us (11824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574275.212694:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788574275.215574:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747640832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574275.597737:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574275.597857:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727735552 00000100:00100000:3.0:1788574275.597872:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727735552 00000100:00100000:3.0:1788574275.597972:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:3.0:1788574275.597987:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+18:12303:x1875455727735552:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:3.0:1788574275.598633:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:12303:x1875455727735552:12345-192.168.201.57@tcp:35:umount.0 Request processed in 647us (909us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788574275.598643:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00080000:0.0:1788574275.598938:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574275.603282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574275.603449:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727735808 00000100:00100000:3.0:1788574275.603464:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727735808 00000100:00100000:3.0:1788574275.603544:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:3.0:1788574275.603556:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+19:12303:x1875455727735808:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:3.0:1788574275.604248:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:12303:x1875455727735808:12345-192.168.201.57@tcp:35:umount.0 Request processed in 690us (980us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788574275.604258:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:2.0:1788574275.608471:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574275.608622:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727736064 00000100:00100000:1.0:1788574275.608635:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727736064 00000100:00100000:1.0:1788574275.608705:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:1.0:1788574275.608717:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7861dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+20:12303:x1875455727736064:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:1.0:1788574275.609174:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7861dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:12303:x1875455727736064:12345-192.168.201.57@tcp:35:umount.0 Request processed in 457us (715us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788574275.609184:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:0.0:1788574275.612025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574275.612118:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727736320 00000100:00100000:3.0:1788574275.612130:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727736320 00000100:00100000:3.0:1788574275.612196:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788574275.612207:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:12303:x1875455727736320:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:3.0:1788574275.612689:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:12303:x1875455727736320:12345-192.168.201.57@tcp:35:umount.0 Request processed in 481us (686us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788574275.612699:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:2.0:1788574275.616699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574275.616753:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574275.616786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574275.616900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727736448 00000100:00100000:0.0:1788574275.616914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727736448 00000100:00100000:0.0:1788574275.616978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727736704 00000100:00100000:0.0:1788574275.616981:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727736704 00000100:00100000:0.0:1788574275.616996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727736576 00000100:00100000:0.0:1788574275.616999:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727736576 00000100:00100000:0.0:1788574275.617029:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788574275.617040:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+15:2356:x1875455727736448:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574275.617059:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574275.617085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21000/0x10531a153b5358d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36d3 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574275.617107:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574275.617199:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+14:2356:x1875455727736448:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 160us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574275.617207:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788574275.617227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:0.0:1788574275.617233:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b105850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+13:2356:x1875455727736704:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574275.617240:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574275.617249:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a780031a00/0x10531a153b535b25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce379e expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574275.617259:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574275.617275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b105850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+12:2356:x1875455727736704:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 42us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574275.617282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:0.0:1788574275.617342:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574275.617348:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+11:2356:x1875455727736576:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574275.617355:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574275.617365:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985000/0x10531a153b5358a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce369b expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574275.617423:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574275.617440:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+10:2356:x1875455727736576:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 92us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574275.617446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:2.0:1788574275.625809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574275.625936:0:10306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727736832 00000100:00100000:3.0:1788574275.625952:0:10306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727736832 00000100:00100000:3.0:1788574275.626071:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:3.0:1788574275.626086:0:10306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2352:x1875455727736832:12345-192.168.201.57@tcp:9:umount.0 00000020:00000080:3.0:1788574275.626133:0:10306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535c13 00000100:00080000:3.0:1788574275.626147:0:10306:0:(import.c:65:import_set_state_nolock()) ffff90a785313800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788574275.626210:0:10306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788574275.626640:0:10306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f540d78c-33c0-4206-a4f5-51879daa7a3f+2:2352:x1875455727736832:12345-192.168.201.57@tcp:9:umount.0 Request processed in 554us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574275.626651:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00080000:0.0:1788574275.626884:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788574275.626948:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574275.636296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574275.636416:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727737216 00000100:00100000:0.0:1788574275.636429:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727737216 00000100:00100000:0.0:1788574275.636542:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:0.0:1788574275.636580:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+7:2352:x1875455727737216:12345-192.168.201.57@tcp:9:umount.0 00000020:00000080:0.0:1788574275.636632:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535e74 00000020:00010000:0.0:1788574275.636644:0:6712:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a791da7000: total 0 00000100:00080000:0.0:1788574275.636651:0:6712:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574275.636717:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788574275.637116:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+5:2352:x1875455727737216:12345-192.168.201.57@tcp:9:umount.0 Request processed in 538us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574275.637127:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00080000:2.0:1788574275.637336:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1788574275.637769:0:5846:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a791da7000: total 0 00010000:00010000:3.0:1788574275.637816:0:5846:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a791da7000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788574275.637902:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000424232fa/0x10531a153b536217 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3973 expref: 4 pid: 12090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.637947:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b5368b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b41 expref: 3 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.637965:0:5846:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a791da7000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788574275.637994:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574275.637997:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574275.637999:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574275.647109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574275.647268:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727738240 00000100:00100000:0.0:1788574275.647280:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727738240 00000100:00100000:0.0:1788574275.647603:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 240 00000100:00100000:0.0:1788574275.647618:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a68214d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+22:2352:x1875455727738240:12345-192.168.201.57@tcp:39:umount.0 00000020:00000080:0.0:1788574275.647663:0:5858:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5358af 00000020:00010000:0.0:1788574275.647683:0:5858:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7a773c000: total 0 00000100:00080000:0.0:1788574275.647689:0:5858:0:(import.c:65:import_set_state_nolock()) ffff90a7a7739800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574275.647730:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788574275.648212:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a68214d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f540d78c-33c0-4206-a4f5-51879daa7a3f+21:2352:x1875455727738240:12345-192.168.201.57@tcp:39:umount.0 Request processed in 595us (1114us total) trans 4294967525 rc 0/0 00000020:00010000:3.0:1788574275.648266:0:6727:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7a773c000: total 0 00010000:00010000:3.0:1788574275.648318:0:6727:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7a773c000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788574275.648391:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:3.0:1788574275.648395:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574275.648405:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984000/0x10531a153b536279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce398f expref: 21 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648427:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574275.648430:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574275.648434:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7600/0x10531a153b5361d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce395e expref: 20 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648447:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574275.648449:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574275.648453:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20400/0x10531a153b536876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b2c expref: 19 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648467:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574275.648470:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574275.648474:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21e00/0x10531a153b536574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3a68 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648496:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574275.648499:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788574275.648504:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfb08200/0x10531a153b5368a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b3a expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648544:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574275.648546:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574275.648550:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984e00/0x10531a153b535ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce389a expref: 16 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648564:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574275.648567:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574275.648571:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b535b79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37ac expref: 15 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648590:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574275.648593:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788574275.648597:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984c00/0x10531a153b536202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce396c expref: 14 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648609:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90a784e37500) 00010000:00010000:3.0:1788574275.648611:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574275.648615:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7a00/0x10531a153b5360f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3926 expref: 13 pid: 10109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648630:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574275.648633:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788574275.648637:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b535be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37c8 expref: 12 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648653:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90a78544f500) 00010000:00010000:3.0:1788574275.648655:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574275.648665:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6600/0x10531a153b536796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3af4 expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648684:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90a78544f300) 00010000:00010000:3.0:1788574275.648686:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788574275.648690:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7bfa4d800/0x10531a153b536295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3996 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648706:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a784e37c00) 00010000:00010000:3.0:1788574275.648708:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574275.648713:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b535b95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce37b3 expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.648725:0:6727:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7a773c000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788574275.648739:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574275.648742:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574275.648743:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574275.654777:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 240 00010000:00010000:2.0:1788574275.904728:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574276.928621:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574277.768062:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574277.768100:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79e7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747640960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574277.768228:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574277.768420:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747640960 00000100:00100000:3.0:1788574277.768433:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747640960 00000100:00100000:3.0:1788574277.768550:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788574277.768562:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747640960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574277.768615:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574277.768682:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747640960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574277.768690:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788574277.769194:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574277.769770:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79e7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747640960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574277.779829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574277.779866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574277.779908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574277.780167:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727738496 00000100:00100000:0.0:1788574277.780191:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727738496 00000100:00100000:0.0:1788574277.780259:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727738368 00000100:00100000:0.0:1788574277.780263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727738368 00000100:00100000:0.0:1788574277.780274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727738624 00000100:00100000:0.0:1788574277.780277:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727738624 00000100:00100000:0.0:1788574277.780293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574277.780306:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+12:2353:x1875455727738496:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574277.780350:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574277.780405:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985e00/0x10531a153b535988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3712 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574277.780428:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574277.780513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+11:2353:x1875455727738496:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 210us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574277.780522:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574277.780544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574277.780550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+10:2353:x1875455727738368:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574277.780573:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574277.780584:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985600/0x10531a153b535981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36e8 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574277.780593:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574277.780611:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+9:2353:x1875455727738368:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 61us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574277.780618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574277.780630:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788574277.780636:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+8:2353:x1875455727738624:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574277.780645:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574277.780654:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a20a00/0x10531a153b535b1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3797 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574277.780664:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574277.780678:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec16a69b-cbad-484e-9f31-b00eca338977+7:2353:x1875455727738624:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 43us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574277.780692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788574277.797768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574277.797888:0:10109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727738880 00000100:00100000:0.0:1788574277.797901:0:10109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727738880 00000100:00100000:0.0:1788574277.798007:0:10109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 241 00000100:00100000:0.0:1788574277.798019:0:10109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+6:2352:x1875455727738880:12345-192.168.201.57@tcp:39:umount.0 00000020:00000080:0.0:1788574277.798078:0:10109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535996 00000020:00010000:0.0:1788574277.798088:0:10109:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a681296800: total 0 00000100:00080000:0.0:1788574277.798093:0:10109:0:(import.c:65:import_set_state_nolock()) ffff90a681296000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574277.798129:0:10109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788574277.798480:0:10109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbb204bb-74e4-44f7-ac26-18a0bfa744ec+5:2352:x1875455727738880:12345-192.168.201.57@tcp:39:umount.0 Request processed in 461us (728us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788574277.798489:0:10109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 241 00000020:00010000:3.0:1788574277.798809:0:6727:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a681296800: total 0 00010000:00010000:3.0:1788574277.798816:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574277.798879:0:6727:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a681296800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788574277.798956:0:6727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70b00) 00010000:00010000:3.0:1788574277.798961:0:6727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574277.798972:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b5368c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b48 expref: 4 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574277.799000:0:6727:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a681296800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788574277.799011:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574277.799013:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574277.799014:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574277.800065:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574277.826540:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574277.826648:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739136 00000100:00100000:0.0:1788574277.826665:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739136 00000100:00100000:0.0:1788574277.826743:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 308 00000100:00100000:0.0:1788574277.826756:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+7:2352:x1875455727739136:12345-192.168.201.57@tcp:251:umount.0 00000020:00000080:0.0:1788574277.826819:0:5852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53588c 00000020:00010000:0.0:1788574277.826829:0:5852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a79229c800: total 0 00000100:00080000:0.0:1788574277.826837:0:5852:0:(import.c:65:import_set_state_nolock()) ffff90a79229e800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788574277.826935:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec16a69b-cbad-484e-9f31-b00eca338977+3:2352:x1875455727739136:12345-192.168.201.57@tcp:251:umount.0 Request processed in 181us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574277.826944:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 308 00000020:00010000:2.0:1788574277.827070:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a79229c800: total 0 00010000:00010000:2.0:1788574277.827169:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a79229c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788574277.827228:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4c600/0x10531a153b5358e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce36da expref: 3 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574277.827250:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a79229c800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788574277.827264:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574277.827266:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574277.827267:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574277.828120:0:5852:0:(genops.c:885:class_export_put()) final put ffff90a79229c800/ec16a69b-cbad-484e-9f31-b00eca338977 00000020:00000080:1.0:1788574277.828333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79229c800/ec16a69b-cbad-484e-9f31-b00eca338977 for MGS 00000020:00000080:1.0:1788574277.828409:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a79229e800 for MGS 00010000:00010000:3.0:1788574277.952740:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574278.976672:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574279.809500:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747641216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.809612:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.809809:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747641728:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.809844:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.809876:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788574279.809882:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747641088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.809917:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.810051:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747641600:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.810078:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.810114:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747641344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.810142:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.810165:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574279.810171:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747641472:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.810212:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.810253:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641216 00000100:00100000:1.0:1788574279.810262:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641216 00000100:00100000:1.0:1788574279.810317:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641600 00000100:00100000:1.0:1788574279.810320:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641600 00000100:00100000:1.0:1788574279.810348:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641344 00000100:00100000:1.0:1788574279.810351:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641344 00000100:00100000:1.0:1788574279.810401:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788574279.810423:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747641216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.810490:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747641216:12345-0@lo:400:kworker.0 Request processed in 80us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.810498:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788574279.810516:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788574279.810523:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747641600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.810551:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747641600:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.810557:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788574279.810568:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788574279.810588:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747641344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.810621:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747641344:12345-0@lo:400:kworker.0 Request processed in 47us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.812149:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788574279.812203:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641728 00000100:00100000:1.0:1788574279.812213:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641728 00000100:00100000:1.0:1788574279.812261:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641472 00000100:00100000:1.0:1788574279.812265:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641472 00000100:00100000:1.0:1788574279.812288:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574279.812298:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747641728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812397:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747641728:12345-0@lo:400:kworker.0 Request processed in 100us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.812403:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574279.812425:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574279.812433:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747641472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812464:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747641472:12345-0@lo:400:kworker.0 Request processed in 32us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.812470:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574279.812491:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641088 00000100:00100000:1.0:1788574279.812495:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641088 00000100:00100000:1.0:1788574279.812523:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788574279.812529:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747641088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812562:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3313:x1875455747641088:12345-0@lo:400:kworker.0 Request processed in 33us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.812569:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1788574279.812623:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574279.812628:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574279.812631:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574279.812706:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747641472:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812742:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747641344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812783:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a547233-5b7a-4801-b1c0-26875afe1265:3313:1875455747641088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812796:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747641600:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812810:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747641216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574279.812821:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747641728:0@lo:400:kworker.0 00000001:00100000:0.0:1788574279.900741:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000001:00080000:0.0:1788574279.900765:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788574279.900771:0:5879:0:(genops.c:885:class_export_put()) final put ffff90a681296800/bbb204bb-74e4-44f7-ac26-18a0bfa744ec 00000001:00100000:0.0:1788574279.900801:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000001:00080000:0.0:1788574279.900808:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788574279.900833:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a681296800/bbb204bb-74e4-44f7-ac26-18a0bfa744ec for lustre-MDT0000 00000020:00000080:0.0:1788574279.900837:0:5879:0:(genops.c:885:class_export_put()) final put ffff90a7a773c000/f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:1.0:1788574279.900912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7a773c000/f540d78c-33c0-4206-a4f5-51879daa7a3f for lustre-MDT0000 00000020:00000080:1.0:1788574279.900974:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a681296000 for lustre-MDT0000 00000020:00000080:1.0:1788574279.900981:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7a7739800 for lustre-MDT0000 00000001:00100000:0.0:1788574279.903125:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:0.0:1788574279.903138:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a791da7000/f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:2.0:1788574279.903215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791da7000/f540d78c-33c0-4206-a4f5-51879daa7a3f for lustre-OST0000 00000020:00000080:2.0:1788574279.903282:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a791da2800 for lustre-OST0000 00000020:01000004:3.0:1788574279.949020:0:12938:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788574279.965874:0:12938:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788574279.965946:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.965966:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.965975:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.965984:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.966015:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788574279.966023:0:12938:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788574279.966052:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574279.966059:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788574279.966067:0:12938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788574279.966104:0:12938:0:(import.c:65:import_set_state_nolock()) ffff90a79b13f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788574279.966398:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574279.966419:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.966427:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4de00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574279.966433:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.966455:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574279.966463:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574279.966468:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574279.966471:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788574279.966475:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788574279.966510:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.966517:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574279.966541:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.966549:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4de00/0x10531a153b53591f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535926 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.966562:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574279.966564:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574279.966566:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574279.966652:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747641984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574279.966754:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.967271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641984 00000100:00100000:1.0:1788574279.967282:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641984 00000100:00100000:1.0:1788574279.967352:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574279.967363:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+19:3314:x1875455747641984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574279.967399:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574279.967428:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165ba00/0x10531a153b535926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b53591f expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574279.967444:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574279.967500:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a547233-5b7a-4801-b1c0-26875afe1265+18:3314:x1875455747641984:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.967508:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574279.967522:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747641984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574279.969461:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747641856:0@lo:39:umount.0 00000100:00100000:1.0:1788574279.969545:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.969609:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747641856 00000100:00100000:1.0:1788574279.970744:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747641856 00000100:00100000:1.0:1788574279.970829:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788574279.970842:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875455747641856:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788574279.970881:0:5857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53569b 00000100:00080000:1.0:1788574279.970894:0:5857:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2b3800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788574279.970991:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875455747641856:12345-0@lo:39:umount.0 Request processed in 151us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.971001:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788574279.971015:0:5857:0:(genops.c:885:class_export_put()) final put ffff90a79b179800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788574279.971049:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574279.971063:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79b179800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788574279.971136:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7bb2b3800 for lustre-MDT0000 00000100:00080000:1.0:1788574279.972284:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a79b13f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788574279.972310:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747641856:0@lo:39:umount.0 00000100:00080000:0.0:1788574279.972924:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574279.972930:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788574279.972937:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788574279.976248:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976274:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976283:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976291:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976321:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574279.976328:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976336:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976343:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976405:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976433:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788574279.976441:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976448:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976454:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976460:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976479:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788574279.976485:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976491:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976497:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976503:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574279.976522:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788574279.976526:0:12938:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788574279.976549:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788574279.976558:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788574279.976560:0:12938:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788574279.976567:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788574279.976572:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788574279.976576:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d600 already unused, calling callback (ffffffffc1bbcc20) 00000020:00000080:0.0:1788574279.976581:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 10000000:00010000:2.0:1788574279.976582:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976592:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788574279.976593:0:12938:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a79e979000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574279.976600:0:12938:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a7c1c1b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1788574279.976601:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788574279.976607:0:12938:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90a7a745cd40) has exports, disconnecting them 10000000:01000000:2.0:1788574279.976608:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574279.976611:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788574279.976613:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1788574279.976613:0:12938:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a79e979000), last request at 1788574279 00000020:00000080:0.0:1788574279.976624:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53580e 00010000:00010000:2.0:1788574279.976668:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976677:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574279.976706:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976713:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b53592d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535934 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976730:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574279.976734:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976740:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165ac00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574279.976743:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976749:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574279.976756:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976757:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976764:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20c00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574279.976765:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574279.976767:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574279.976771:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574279.976773:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788574279.976774:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574279.976775:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:3.0:1788574279.976780:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574279.976785:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788574279.976787:0:6727:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788574279.976788:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574279.976789:0:6727:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788574279.976793:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574279.976802:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976808:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574279.976815:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976815:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976823:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b535b48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535b4f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976823:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b535846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b53584d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976835:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574279.976838:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574279.976838:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574279.976840:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574279.976841:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574279.976854:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031e00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574279.976857:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976863:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574279.976869:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574279.976874:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574279.976876:0:6727:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788574279.976878:0:6727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788574279.976891:0:6727:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976897:0:6727:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574279.976902:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976908:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780031e00/0x10531a153b5355fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b535601 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.976920:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574279.976921:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574279.976923:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574279.976961:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747642112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574279.977055:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574279.977118:0:12938:0:(import.c:65:import_set_state_nolock()) ffff90a79e97a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788574279.977270:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788574279.977288:0:12938:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a79e979000): rc 0 00000020:00000080:0.0:1788574279.977291:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a79e979000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788574279.977347:0:12938:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a7c1c1b800), last request at 1788574279 00000020:00000080:0.0:1788574279.977353:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535743 00000100:00080000:0.0:1788574279.977361:0:12938:0:(import.c:65:import_set_state_nolock()) ffff90a7c1c1b000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788574279.977417:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788574279.977479:0:12938:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7c1c1b800): rc 0 00000020:00000080:0.0:1788574279.977481:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7c1c1b800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788574279.977505:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574279.977546:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79e979000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788574279.977661:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a79e97a800 for lustre-MDT0000 00000100:00100000:2.0:1788574279.977843:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574279.977846:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747642112 00000100:00100000:2.0:1788574279.977854:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747642496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574279.977865:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747642112 00000100:00100000:2.0:1788574279.977887:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574279.977922:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747642496 00000100:00100000:3.0:1788574279.977926:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747642496 00000100:00100000:3.0:1788574279.977946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574279.977955:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+19:3315:x1875455747642112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574279.977971:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574279.977989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4c200/0x10531a153b535934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b53592d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.978005:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574279.978044:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+18:3315:x1875455747642112:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574279.978052:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574279.978071:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788574279.978078:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b105450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+17:3315:x1875455747642496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574279.978086:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574279.978095:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165be00/0x10531a153b535601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b5355fa expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.978108:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574279.978130:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b105450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+16:3315:x1875455747642496:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574279.978210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574279.978233:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747642112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574279.978265:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747642496:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1788574279.978403:0:12938:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3a24187bae0 00000100:00080000:0.0:1788574279.978443:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788574279.978447:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788574279.978462:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788574279.978528:0:12938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788574279.978551:0:12938:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2d6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788574279.978567:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788574279.978570:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788574279.978589:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788574279.978671:0:12938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788574279.978682:0:12938:0:(import.c:65:import_set_state_nolock()) ffff90a78f4f9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788574279.978718:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a7a745cd40) has no exports 00000100:00100000:1.0:1788574279.978978:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747642624:0@lo:9:umount.0 00000100:00100000:1.0:1788574279.979049:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.979079:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747642752:0@lo:9:umount.0 00000100:00100000:1.0:1788574279.979102:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574279.979147:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747642624 00000100:00100000:1.0:1788574279.979154:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747642624 00000100:00100000:1.0:1788574279.979197:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747642752 00000100:00100000:1.0:1788574279.979201:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747642752 00000100:00100000:1.0:1788574279.979221:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574279.979227:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875455747642624:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788574279.979266:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535790 00000100:00080000:1.0:1788574279.979275:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a7c1c1f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574279.979318:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788574279.980348:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3311:x1875455747642624:12345-0@lo:9:umount.0 Request processed in 1113us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.980362:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574279.980421:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574279.980432:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875455747642752:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788574279.980455:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535877 00000100:00080000:1.0:1788574279.980466:0:6713:0:(import.c:65:import_set_state_nolock()) ffff90a7a773f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574279.980499:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788574279.980613:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3311:x1875455747642752:12345-0@lo:9:umount.0 Request processed in 184us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574279.980620:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788574279.980750:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574279.980758:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574279.981126:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747642240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574279.981177:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788574279.981216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c1c1b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788574279.981223:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574279.981229:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747642368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574279.981250:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788574279.981270:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7c1c1b000 for lustre-MDT0000 00000100:00100000:3.0:1788574279.981567:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747642240 00000100:00100000:3.0:1788574279.981577:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747642240 00000100:00100000:3.0:1788574279.981627:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747642368 00000100:00100000:3.0:1788574279.981642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747642368 00000100:00100000:3.0:1788574279.981682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574279.981689:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+17:3312:x1875455747642240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574279.981701:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574279.981722:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4c400/0x10531a153b53584d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b535846 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.981743:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574279.981779:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+16:3312:x1875455747642240:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574279.981786:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574279.981800:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574279.981806:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+15:3312:x1875455747642368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574279.981813:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574279.981822:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21200/0x10531a153b535b4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b535b48 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574279.981831:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574279.981852:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a547233-5b7a-4801-b1c0-26875afe1265+14:3312:x1875455747642368:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574279.981858:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788574279.982205:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2d6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788574279.982233:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788574279.982235:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574279.982240:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747642624:0@lo:9:umount.0 00000100:00080000:0.0:1788574279.982256:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a78f4f9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788574279.982263:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788574279.982264:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574279.982266:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747642752:0@lo:9:umount.0 00000100:00100000:2.0:1788574279.982764:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747642368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574279.982771:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a547233-5b7a-4801-b1c0-26875afe1265:3312:1875455747642240:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788574279.988660:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a7a745cd40) has no exports 00000020:00000080:0.0:1788574280.071256:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535655 00000020:00000080:0.0:1788574280.071278:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7b9dfd000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788574280.071307:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788574280.071364:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7b9dfd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788574280.071473:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574280.071487:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574280.071494:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90a7a74599c0) has no exports 00010000:00010000:2.0:1788574280.071565:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574280.071945:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53564e 00000020:00000080:1.0:1788574280.071954:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bd0ef800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788574280.072057:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574280.072066:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788574280.072070:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bc13a000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788574280.072073:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc13a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788574280.072078:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788574280.072415:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bd0ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788574280.074610:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7bbb4e000 - data ffff90a7b1e7be58/ffff90a79e974800 00000020:01000000:1.0:1788574280.074993:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a79b00d2a0 - data ffff90a792b1a438/ffff90a7bb2cf000 00000001:00000004:1.0:1788574280.091726:0:12938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788574280.314356:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574280.314421:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788574280.314448:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574280.314452:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788574280.314674:0:6988:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788574280.314680:0:6988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788574280.314692:0:6988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788574280.315718:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574280.315723:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788574280.315743:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574280.315746:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788574280.315900:0:8047:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788574280.315906:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788574280.315918:0:8047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:3.0:1788574280.380750:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788574280.380764:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a7a7738800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788574280.380807:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:3.0:1788574280.380811:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a785311800/f540d78c-33c0-4206-a4f5-51879daa7a3f 00000020:00000080:0.0:1788574280.380858:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7a7738800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788574280.380924:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785311800/f540d78c-33c0-4206-a4f5-51879daa7a3f for lustre-OST0001 00000020:00000080:0.0:1788574280.380966:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7a773f800 for lustre-OST0001 00000020:00000080:0.0:1788574280.380973:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a785313800 for lustre-OST0001 00000020:00000080:0.0:1788574280.455718:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53561d 00000020:00000080:0.0:1788574280.455735:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bb2b1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574280.456415:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788574280.462199:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535632 00000020:00000080:0.0:1788574280.462218:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bc13a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574280.462236:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788574280.462245:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574280.462254:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574280.462258:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90a7a745b380) has no exports 00000020:00000080:2.0:1788574280.462553:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc13a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788574280.462824:0:12938:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788574280.462852:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535870 00000020:00000080:0.0:1788574280.462857:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a785e1a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574280.462875:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788574280.462879:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574280.462886:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574280.462890:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90a793288000) has no exports 00000020:00000080:0.0:1788574280.462896:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535869 00000020:00000080:0.0:1788574280.462900:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a78f4fc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574280.463271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785e1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788574280.463280:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78f4fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788574280.465815:0:12938:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788574280.465825:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788574280.465830:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788574280.465839:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574280.465842:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574280.465885:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574280.465898:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574280.465907:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535789 00000020:00000080:0.0:1788574280.465918:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bfbe5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574280.465941:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788574280.465949:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574280.465955:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574280.465958:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90a7924b8000) has no exports 00000020:00000080:0.0:1788574280.465966:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535782 00000020:00000080:0.0:1788574280.465970:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bb2b7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574280.466710:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a78f4f9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788574280.466720:0:8:0:(genops.c:885:class_export_put()) final put ffff90a681294800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574280.466723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a681294800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788574280.466729:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574280.466806:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bfbe5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788574280.466811:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2b7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788574280.467146:0:12938:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788574280.467152:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788574280.467155:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788574280.467159:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574280.467162:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574280.467249:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574280.467257:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574280.467298:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574280.467302:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574280.467318:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bb2b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788574280.467320:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2b7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788574280.467325:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574280.467497:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535639 00000020:00000080:0.0:1788574280.467504:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bc139000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788574280.467900:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7bb2d6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788574280.467908:0:8:0:(genops.c:885:class_export_put()) final put ffff90a6812f7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574280.467910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6812f7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788574280.467915:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788574280.468145:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788574280.468151:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574280.468157:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574280.468161:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90a7a7458000) has no exports 00000020:00000080:0.0:1788574280.468183:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574280.468188:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788574280.468192:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535640 00000020:00000080:0.0:1788574280.468196:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bc13b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574280.468215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc139000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788574280.468219:0:8:0:(genops.c:885:class_export_put()) final put ffff90a7b9dfa000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788574280.468221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7b9dfa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788574280.468224:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788574280.468757:0:12938:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a790a3d000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788574280.468762:0:12938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a790a3d000 3 00000020:01000004:0.0:1788574280.468765:0:12938:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a790a3d000 from lustre-MDT0000 00000020:00000080:0.0:1788574280.468790:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574280.468795:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788574280.468798:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a7bb2b5000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788574280.468800:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2b5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788574280.468807:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788574280.468847:0:12938:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788574280.468850:0:12938:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788574280.468853:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788574280.468856:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574280.468858:0:12938:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574280.468865:0:12938:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90a786922800 2a547233-5b7a-4801-b1c0-26875afe1265 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574280.468870:0:12938:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90a79b183380) has exports, disconnecting them 00000020:00080000:0.0:1788574280.468875:0:12938:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90a786922800), last request at 1788574044 00000020:00000080:0.0:1788574280.468888:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5355de 00000020:00010000:0.0:1788574280.468892:0:12938:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a786922800: total 1 00000100:00080000:0.0:1788574280.468906:0:12938:0:(import.c:65:import_set_state_nolock()) ffff90a786922000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788574280.469041:0:12938:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a786922800): rc 0 00000020:00080000:0.0:1788574280.469046:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90a79b183380) has no exports 00000100:00100000:0.0:1788574280.469098:0:5852:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90a785eb3e00:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1788574280.469225:0:5851:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90a792271c00:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788574280.469268:0:5849:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90a792271400:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1788574280.469428:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469436:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469442:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469449:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469455:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469461:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469467:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469473:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469480:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469486:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469493:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469499:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469505:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469647:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469653:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469659:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469665:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469671:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469677:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469682:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469688:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469692:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469698:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469703:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469708:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469713:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469719:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469725:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469742:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469747:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469751:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469757:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469762:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469768:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469773:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469778:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469783:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469789:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469794:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469799:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469804:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469809:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469814:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469819:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469825:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469829:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469835:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469840:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469845:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469850:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469855:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469860:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469865:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469871:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469876:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469882:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469888:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469894:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469899:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469904:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469909:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469914:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.469919:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574280.470210:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788574280.470803:0:12938:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788574280.470807:0:12938:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1788574280.471036:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc13b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788574280.472256:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a78165ae00/0x10531a153b5356f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b5356ef expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472282:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165ae00/0x10531a153b5356f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b5356ef expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472488:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a790a21a00/0x10531a153b5358ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b5358e7 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472502:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21a00/0x10531a153b5358ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b5358e7 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472511:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a790a21800/0x10531a153b5358fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b5358f5 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472518:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21800/0x10531a153b5358fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b5358f5 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472527:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a78165b400/0x10531a153b53590a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b535903 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472535:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165b400/0x10531a153b53590a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b535903 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472544:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a79e985800/0x10531a153b535918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b535911 expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472551:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985800/0x10531a153b535918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b535911 expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472576:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a79e984200/0x10531a153b535942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b53593b expref: 4 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472586:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e984200/0x10531a153b535942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b53593b expref: 4 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472597:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a790a20000/0x10531a153b535b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b535b2c expref: 3 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472606:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a20000/0x10531a153b535b33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b535b2c expref: 3 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472615:0:12938:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff90a790a21c00/0x10531a153b535b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x10531a153b535b3a expref: 2 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574280.472623:0:12938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21c00/0x10531a153b535b41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x10531a153b535b3a expref: 2 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1788574280.472724:0:5846:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a786922800: total 0 00010000:00010000:1.0:1788574280.472783:0:5846:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a786922800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788574280.472799:0:5846:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a786922800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1788574280.472811:0:5846:0:(genops.c:885:class_export_put()) final put ffff90a786922800/2a547233-5b7a-4801-b1c0-26875afe1265 00010000:00010000:1.0:1788574280.472835:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574280.472839:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574280.472842:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574280.473010:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a786922800/2a547233-5b7a-4801-b1c0-26875afe1265 for MGS 00000020:00000080:0.0:1788574280.473042:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a786922000 for MGS 00010000:00010000:1.0:1788574281.089527:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574282.112617:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788574282.497138:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a78c95c000 - data ffff90a7bfd45ca8/ffff90a7a772e400 00000020:01000000:0.0:1788574282.497444:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a783640840 - data ffff90a78204d438/ffff90a79245d800 00000020:00000080:0.0:1788574282.499771:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5355c2 00000020:00000080:0.0:1788574282.499790:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a78c8f2000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788574282.499819:0:12938:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a790a3d000 from MGS, refs=2 00000020:01000004:0.0:1788574282.499826:0:12938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a790a3d000 2 00000020:01000004:0.0:1788574282.499831:0:12938:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a790a3d000 from MGS 00000020:00000080:0.0:1788574282.499871:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574282.499883:0:12938:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788574282.499980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78c8f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788574282.500130:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a78c8f0000/MGS 00000020:00000080:0.0:1788574282.500136:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78c8f0000/MGS for MGS 00000020:01000000:0.0:1788574282.500399:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788574282.500613:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788574282.501087:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574282.501094:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574282.501100:0:12938:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90a79b13d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574282.501106:0:12938:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90a79b184d40) has exports, disconnecting them 00000020:00080000:0.0:1788574282.501110:0:12938:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90a79b13d000), last request at 1788574045 00000020:00000080:0.0:1788574282.501114:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53568d 00000020:00080000:0.0:1788574282.501127:0:12938:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a79b13d000): rc 0 00000020:00000080:0.0:1788574282.501131:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a79b13d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788574282.501878:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79b13d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788574282.506669:0:12938:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788574282.506680:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574282.506685:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574282.506695:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574282.506886:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574282.507735:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a79b13f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788574282.513681:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788574282.513693:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a79b139000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788574282.513699:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79b139000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788574282.513716:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788574282.516884:0:12938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a790a3d000 1 00000020:00000080:2.0:1788574282.516910:0:12938:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5355b4 00000020:00000080:2.0:1788574282.516920:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a78c8f4000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788574282.516946:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788574282.516952:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574282.516960:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788574282.516964:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90a79b1819c0) has no exports 00000020:00000080:1.0:1788574282.517066:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78c8f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788574282.633347:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574282.633400:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788574282.633409:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a78c8f3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574282.633413:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78c8f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788574282.633434:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788574282.633570:0:12938:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a79924c800 00000020:01000000:3.0:1788574282.633598:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788574282.633604:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574282.633609:0:12938:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788574282.633614:0:12938:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90a7924bb380) has no exports 00000100:00100000:3.0:1788574282.633708:0:10109:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90a7bbf02400:10109] 3 exiting: rc = 0 00000100:00100000:3.0:1788574282.633832:0:5859:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90a791006e00:5859] 2 exiting: rc = 0 00000100:00100000:3.0:1788574282.633917:0:5857:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90a791006400:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1788574282.634267:0:5858:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90a79242f400:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1788574282.649578:0:11654:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff90a7a0259e00:11654] 4 exiting: rc = 0 00000100:00100000:3.0:1788574282.652160:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652171:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652178:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652184:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652189:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652195:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652201:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652208:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652213:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652218:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652224:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652228:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652234:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652239:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652244:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652249:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652254:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652259:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652265:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652271:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652571:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652577:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652583:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652589:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652597:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652622:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652628:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652634:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652640:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652646:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652652:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652658:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652664:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652670:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652676:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652684:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652691:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652697:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652704:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652710:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652716:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652722:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652729:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652736:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652742:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652747:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652753:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652759:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652765:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652770:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652776:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652782:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652787:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652792:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652798:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652804:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652809:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652815:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652820:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652825:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652838:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652843:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652849:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.652866:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.674263:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90a785fd5600:5860] 0 exiting: rc = 1 00000100:00100000:2.0:1788574282.674575:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90a785fd5e00:5861] 1 exiting: rc = 0 00000100:00100000:3.0:1788574282.675198:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675206:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675212:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675217:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675224:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675229:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675235:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675241:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675247:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675252:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675257:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675264:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675339:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675347:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675352:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675357:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675437:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675445:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675451:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675455:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675461:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675465:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675470:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675475:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675481:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675485:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675490:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675495:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675500:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675504:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675520:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675525:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675530:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675535:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675540:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675546:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675551:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675557:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675562:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675567:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675571:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675577:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675581:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675586:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675591:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675597:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675602:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675607:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675613:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675618:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675623:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675628:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675633:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675639:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675645:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675650:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675660:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675667:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675672:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675677:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675682:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675688:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675693:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.675698:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574282.678069:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90a79242e800:5862] 0 exiting: rc = 1 00000100:00100000:1.0:1788574282.678575:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90a79242e200:5863] 1 exiting: rc = 0 00000100:00100000:3.0:1788574282.678712:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678736:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678742:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678748:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678755:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678762:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678768:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678774:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678781:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678801:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678809:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678814:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678819:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678826:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678833:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678838:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678845:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678851:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678858:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678864:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678870:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678906:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678914:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678920:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678926:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678932:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678938:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678945:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678950:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678956:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678963:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678968:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678975:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.678996:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679003:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679009:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679021:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679027:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679033:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679039:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679046:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679053:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679060:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679065:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679072:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679102:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679111:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679119:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679125:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679132:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679140:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679148:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679153:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679158:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679164:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679169:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679174:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679194:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679202:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679208:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679215:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679221:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679227:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.679243:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574282.698660:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90a79242f000:5864] 0 exiting: rc = 1 00000100:00100000:1.0:1788574282.700591:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90a7a019ac00:5865] 1 exiting: rc = 0 00000100:00100000:3.0:1788574282.700747:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700755:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700760:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700766:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700771:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700777:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700783:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700806:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700811:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700816:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700821:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700826:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700832:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700837:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700843:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700848:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700853:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700859:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700865:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700870:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700875:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700880:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700885:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700902:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700908:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700913:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700918:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700923:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700928:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700933:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700938:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700944:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700949:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700954:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700960:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700965:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700970:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700975:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700980:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700985:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700990:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.700995:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701008:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701014:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701019:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701024:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701030:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701034:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701038:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701043:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701049:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701054:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701059:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701064:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701070:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701075:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701080:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701084:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701089:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701093:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701098:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701103:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701109:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.701115:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574282.702065:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90a7a019b400:5867] 1 exiting: rc = 0 00000100:00100000:1.0:1788574282.702332:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90a7a019ae00:5866] 0 exiting: rc = 1 00000100:00100000:3.0:1788574282.702480:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702487:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702492:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702497:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702502:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702507:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702513:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702518:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702525:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702530:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702535:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702540:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702545:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702561:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702566:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702572:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702577:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702582:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702587:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702592:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702597:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702602:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702607:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702613:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702617:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702622:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702627:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702632:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702637:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702641:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702645:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702650:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702655:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702661:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702666:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702672:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702677:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702681:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702686:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702691:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702695:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702700:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702705:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702710:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702716:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702721:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702727:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702732:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702745:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702749:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702754:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702759:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702764:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702769:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702774:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702778:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702783:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702789:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702793:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702798:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702803:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702807:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702812:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.702816:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574282.705553:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90a7a019aa00:5869] 1 exiting: rc = 0 00000100:00100000:1.0:1788574282.706019:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90a7a019a400:5868] 0 exiting: rc = 1 00000100:00100000:3.0:1788574282.706178:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706186:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706191:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706196:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706201:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706206:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706211:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706215:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706220:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706224:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706229:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706233:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706238:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706242:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706247:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706251:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706255:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706260:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706264:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706295:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706299:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706305:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706309:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706314:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706319:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706324:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706330:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706335:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706340:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706346:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706351:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706356:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706393:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706398:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706403:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706409:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706414:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706419:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706424:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706430:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706434:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706439:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706444:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706449:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706454:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706458:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706463:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706468:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706473:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706478:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706483:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706487:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706492:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706497:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706510:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706515:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706520:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706525:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706529:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706533:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706538:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706542:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706546:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.706551:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574282.707345:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90a7923ec200:5871] 1 exiting: rc = 0 00000100:00100000:1.0:1788574282.707632:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90a7923ec800:5870] 0 exiting: rc = 1 00000100:00100000:0.0:1788574282.707978:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90a792400800:5872] 2 exiting: rc = 0 00000100:00100000:3.0:1788574282.708235:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708245:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708251:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708258:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708264:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708281:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708288:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708293:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708298:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708315:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708323:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708329:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708334:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708340:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708352:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708357:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708398:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708406:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708411:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708417:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708423:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708428:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708433:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708439:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708444:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708463:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708468:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708473:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708478:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708484:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708489:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708494:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708500:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708520:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708528:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708533:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708539:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708544:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708550:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708555:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708562:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708568:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708574:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708580:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708586:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708593:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708598:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708604:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708609:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708615:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708621:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708628:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708633:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708639:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708645:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708652:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708659:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708664:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708669:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708675:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708688:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708694:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708700:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574282.708706:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788574282.719786:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574282.719800:0:12938:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788574282.719806:0:12938:0:(genops.c:885:class_export_put()) final put ffff90a79b178800/MDS_uuid 00000020:00000080:3.0:1788574282.719811:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79b178800/MDS_uuid for MDS 00000020:01000000:3.0:1788574282.719821:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788574282.720047:0:12938:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788574283.136605:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574284.160668:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574284.932010:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747642880:0@lo:400:kworker.0 00000400:00000100:2.0:1788574284.932095:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455747642880 offset 0 length 224: 4 00000100:00100000:2.0:1788574284.932210:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747643008:0@lo:400:kworker.0 00000400:00000100:2.0:1788574284.933082:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747643008 offset 0 length 224: 4 00000100:00100000:2.0:1788574284.933115:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574284.933126:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747643136:0@lo:400:kworker.0 00000400:00000100:2.0:1788574284.933150:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747643136 offset 0 length 224: 4 00000001:00100000:3.0:1788574285.020251:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788574285.020266:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a7c1c1a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788574285.024791:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c1c1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788574285.024897:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7c1c1f000 for lustre-OST0000 00010000:00010000:1.0:1788574285.184774:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574286.208565:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788574286.297928:0:13091:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788574286.310525:0:13091:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788574286.310589:0:13091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574286.310605:0:13091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574286.310612:0:13091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574286.310620:0:13091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574286.310643:0:13091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788574286.310676:0:13091:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788574286.310704:0:13091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574286.310719:0:13091:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7933bb800 x1875455747643008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574286.310742:0:13091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788574286.310750:0:13091:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788574286.310788:0:13091:0:(import.c:65:import_set_state_nolock()) ffff90a6812f2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788574286.310829:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747643264:0@lo:39:umount.0 00000400:00000100:0.0:1788574286.310910:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747643264 offset 0 length 224: 4 00000100:00100000:3.0:1788574286.311080:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747643008:0@lo:400:kworker.0 00010000:00010000:1.0:1788574286.311476:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574286.311486:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574286.311496:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574286.311501:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574286.311512:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574286.311520:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574286.311527:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574286.311530:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788574286.311533:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788574286.311567:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574286.311575:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788574286.311620:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747643392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574286.311680:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574286.311758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747643392 00000100:00100000:0.0:1788574286.311768:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747643392 00000100:00100000:0.0:1788574286.311826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574286.311835:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1875455747643392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788574286.311843:0:5842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574286 with bad export cookie 1176312606165784030 00010000:00010000:1.0:1788574286.314382:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574286.314406:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d200/0x10531a153b535903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b53590a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574286.314427:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574286.314430:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574286.314433:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574286.320582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1875455747643392:12345-0@lo:103:ldlm_bl.0 Request processed in 8729us (8885us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788574286.320607:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788574286.320814:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.157@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788574286.320821:0:3314:0:(import.c:65:import_set_state_nolock()) ffff90a78c8f3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788574286.320825:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788574286.335343:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.157@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788574286.335353:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788574286.335525:0:3314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7933b9180 x1875455747642880/t0(0) o400->MGC192.168.201.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788574300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574286.335560:0:3314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7a7846a00 x1875455747643392/t0(0) o103->MGC192.168.201.157@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574302 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788574286.335573:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788574286.335577:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788574286.335579:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788574286.335586:0:3314:0:(import.c:65:import_set_state_nolock()) ffff90a78c8f3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574286.335593:0:3314:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:2.0:1788574286.335639:0:3314:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import ffff90a78c8f3800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574286.335641:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a547233-5b7a-4801-b1c0-26875afe1265:3315:1875455747642880:0@lo:400:kworker.0 00000100:00100000:0.0:1788574286.337205:0:3314:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a788f480 x1875455747643520/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574286.337295:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a547233-5b7a-4801-b1c0-26875afe1265:3311:1875455747643520:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788574286.337432:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455747643520 offset 0 length 520: 4 00000100:00100000:0.0:1788574286.337536:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a547233-5b7a-4801-b1c0-26875afe1265:3314:1875455747643392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574287.233781:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574288.258336:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574289.280662:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574290.048721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574290.048736:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574290.049104:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747643648:0@lo:400:kworker.0 00000400:00000100:2.0:1788574290.049212:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747643648 offset 0 length 224: 4 00010000:00010000:1.0:1788574290.315814:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574291.073999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574291.074010:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574291.074153:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574291.074180:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747643776:0@lo:400:kworker.0 00000400:00000100:2.0:1788574291.074255:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747643776 offset 0 length 224: 4 00010000:00010000:2.0:1788574291.328592:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574292.353138:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574293.377256:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574294.400685:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574295.425784:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574296.194803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788574296.194812:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574296.194997:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574296.195017:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747643904:0@lo:400:kworker.0 00000400:00000100:3.0:1788574296.195088:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747643904 offset 0 length 224: 4 00010000:00010000:1.0:1788574296.450392:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574296.706365:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574286/real 1788574286] req@ffff90a7a788f480 x1875455747643520/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574296.706425:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a788f480 x1875455747643520/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574296.706437:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574286/real 1788574286] req@ffff90a7a788c000 x1875455747643264/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574296.706450:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a788c000 x1875455747643264/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574296.706472:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a78c8f3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574296.706504:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788574296.706508:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a547233-5b7a-4801-b1c0-26875afe1265:3311:1875455747643520:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788574296.706515:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a6812f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788574296.706536:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747643264:0@lo:39:umount.0 00000100:00080000:0.0:1788574296.706597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788574296.706602:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788574296.706605:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a78c8f3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574296.706631:0:37:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1788574296.706638:0:37:0:(import.c:630:import_select_connection()) MGC192.168.201.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788574296.706645:0:37:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import ffff90a78c8f3800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574296.706689:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a788ea00 x1875455747644032/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574296.706825:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a547233-5b7a-4801-b1c0-26875afe1265:3311:1875455747644032:0@lo:250:kworker.0 00000400:00000100:1.0:1788574296.706876:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455747644032 offset 0 length 520: 4 00000100:00080000:3.0:1788574296.706993:0:13091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574296.706998:0:13091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788574296.707004:0:13091:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788574296.708334:0:13091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708351:0:13091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708395:0:13091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708402:0:13091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708428:0:13091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574296.708436:0:13091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708442:0:13091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708448:0:13091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708454:0:13091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574296.708472:0:13091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788574296.708477:0:13091:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788574296.708498:0:13091:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788574296.708502:0:13091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788574296.708507:0:13091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574296.708513:0:13091:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788574296.708517:0:13091:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90a79241b380) has no exports 00010000:00010000:1.0:1788574296.708531:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574296.708538:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788574296.708541:0:13091:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90a79241b380) has no exports 00010000:00010000:1.0:1788574296.708545:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4da00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574296.708549:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708558:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574296.708565:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574296.708570:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574296.708573:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788574296.708575:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788574296.708587:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:1.0:1788574296.708590:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708598:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4da00/0x10531a153b535911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535918 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708611:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574296.708614:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708620:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574296.708631:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708638:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574296.708644:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574296.708659:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788574296.708661:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788574296.708663:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788574296.708668:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:1.0:1788574296.708671:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708678:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e985200/0x10531a153b535b3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535b41 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574296.708686:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574296.708688:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574296.708690:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574296.709068:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788574296.711611:0:13091:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a782cfaa20 - data ffff90a7bfdbf0d8/ffff90a79e883000 00000020:01000000:3.0:1788574296.711745:0:13091:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7a71146c0 - data ffff90a7b1c7f5e8/ffff90a7bfbbf000 00100000:10000000:3.0:1788574296.723739:0:13091:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788574296.796412:0:13091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535712 00000020:00000080:2.0:1788574296.796427:0:13091:0:(genops.c:885:class_export_put()) final put ffff90a7c1c1e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788574296.796444:0:13091:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a785e1b800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788574296.796448:0:13091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a785e1b800 2 00000020:01000004:2.0:1788574296.796451:0:13091:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a785e1b800 from lustre-OST0000 00000020:00000080:1.0:1788574296.796452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c1c1e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788574296.796476:0:13091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574296.796592:0:13091:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788574296.796597:0:13091:0:(genops.c:885:class_export_put()) final put ffff90a7c1c1a800/lustre-OST0000_UUID 00000020:00000080:2.0:1788574296.796599:0:13091:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c1c1a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788574296.796606:0:13091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788574296.796658:0:13091:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788574296.796663:0:13091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788574296.796667:0:13091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574296.796671:0:13091:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788574296.796678:0:13091:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90a6812f0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574296.796684:0:13091:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff90a7924bcd40) has exports, disconnecting them 00000020:00080000:2.0:1788574296.796690:0:13091:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90a6812f0000), last request at 1788574062 00000020:00000080:2.0:1788574296.796694:0:13091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53573c 00000020:00080000:2.0:1788574296.796713:0:13091:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6812f0000): rc 0 00000020:00000080:2.0:1788574296.796718:0:13091:0:(genops.c:885:class_export_put()) final put ffff90a6812f0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788574296.796780:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6812f0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788574296.798797:0:13091:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788574296.798806:0:13091:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574296.798811:0:13091:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788574296.798820:0:13091:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574296.799106:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6812f2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788574296.799270:0:13091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574296.799279:0:13091:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788574296.799285:0:13091:0:(genops.c:885:class_export_put()) final put ffff90a7bb2b2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788574296.799288:0:13091:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2b2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788574296.799301:0:13091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788574296.799398:0:13091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a785e1b800 1 00000020:00000080:3.0:1788574296.799406:0:13091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5356cc 00000020:00000080:3.0:1788574296.799414:0:13091:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d7000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788574296.799424:0:13091:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788574296.799429:0:13091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574296.799434:0:13091:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788574296.799438:0:13091:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90a7924199c0) has no exports 00000020:00000080:1.0:1788574296.799526:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788574296.841956:0:13091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574296.841975:0:13091:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788574296.841981:0:13091:0:(genops.c:885:class_export_put()) final put ffff90a785e1d800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788574296.841986:0:13091:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785e1d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788574296.842001:0:13091:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788574296.842149:0:13091:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a785e19800 00000020:02000400:3.0:1788574296.842190:0:13091:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788574297.473610:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574298.498794:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574299.521505:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574300.071951:0:13244:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788574300.083939:0:13244:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788574300.084028:0:13244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574300.084055:0:13244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574300.084073:0:13244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574300.084081:0:13244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574300.084109:0:13244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788574300.084115:0:13244:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788574300.084137:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574300.084149:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7933bb100 x1875455747643136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574300.084173:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7926b1f80 x1875455747643648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574306 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574300.084198:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7a7844700 x1875455747643776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574300.084211:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7a788ce00 x1875455747643904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574312 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574300.084220:0:13244:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788574300.084227:0:13244:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788574300.084258:0:13244:0:(import.c:65:import_set_state_nolock()) ffff90a7a773a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788574300.084292:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747644160:0@lo:39:umount.0 00000400:00000100:1.0:1788574300.084346:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747644160 offset 0 length 224: 4 00000100:00100000:0.0:1788574300.084522:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747643648:0@lo:400:kworker.0 00010000:00010000:2.0:1788574300.084657:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574300.084666:0:6727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574300.084675:0:6727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165aa00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574300.084680:0:6727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574300.084690:0:6727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574300.084697:0:6727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574300.084703:0:6727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574300.084705:0:6727:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788574300.084708:0:6727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788574300.084725:0:6727:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:2.0:1788574300.084729:0:6727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574300.084737:0:6727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165aa00/0x10531a153b5358e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b5358ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574300.084749:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574300.084751:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574300.084752:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574300.084778:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747643776:0@lo:400:kworker.0 00000100:00100000:3.0:1788574300.084898:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747643904:0@lo:400:kworker.0 00000100:00100000:3.0:1788574300.084908:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747643136:0@lo:400:kworker.0 00010000:00010000:1.0:1788574300.544839:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574301.568743:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574301.847801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574301.847812:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788574302.593933:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574303.617012:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574304.641496:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574305.664823:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574306.688661:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574306.946418:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574306.946431:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a547233-5b7a-4801-b1c0-26875afe1265->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788574307.716999:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574308.737021:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574309.762000:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574310.336507:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574300/real 1788574300] req@ffff90a7a7847b80 x1875455747644160/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574310 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574310.336545:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a7847b80 x1875455747644160/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574310 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574310.336566:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7a773a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788574310.336588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747644160:0@lo:39:umount.0 00000100:00080000:1.0:1788574310.336937:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574310.336942:0:13244:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788574310.336948:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788574310.341813:0:13244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341833:0:13244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341841:0:13244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341848:0:13244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341872:0:13244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574310.341878:0:13244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341895:0:13244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341902:0:13244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341927:0:13244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574310.341949:0:13244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788574310.341954:0:13244:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788574310.341975:0:13244:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788574310.341979:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788574310.341983:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574310.341988:0:13244:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574310.341993:0:13244:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90a791dcb380) has no exports 00000020:00080000:1.0:1788574310.342019:0:13244:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90a791dcb380) has no exports 00010000:00010000:2.0:1788574310.347668:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574310.347688:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347702:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4dc00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574310.347707:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347718:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574310.347726:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574310.347732:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574310.347769:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788574310.347773:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788574310.347797:0:5846:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:2.0:1788574310.347800:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347807:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4dc00/0x10531a153b5358f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b5358fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347821:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574310.347824:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347829:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574310.347832:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347838:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574310.347844:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574310.347849:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788574310.347851:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788574310.347853:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788574310.347856:0:5846:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:2.0:1788574310.347860:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347866:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d400/0x10531a153b535b2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535b33 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574310.347894:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574310.347896:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574310.347898:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574310.348406:0:6727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788574310.360256:0:13244:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a782cfade0 - data ffff90a7bfdbf5e8/ffff90a7a74f4400 00000020:01000000:1.0:1788574310.360878:0:13244:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a791072840 - data ffff90a7b1c62798/ffff90a7a74d6000 00100000:10000000:0.0:1788574310.387549:0:13244:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788574310.449364:0:13244:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5357dd 00000020:00000080:3.0:1788574310.449392:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a79e97b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788574310.449405:0:13244:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6812f6000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788574310.449421:0:13244:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6812f6000 2 00000020:01000004:3.0:1788574310.449424:0:13244:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a6812f6000 from lustre-OST0001 00000020:00000080:3.0:1788574310.449467:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574310.449478:0:13244:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788574310.449482:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a79e97c800/lustre-OST0001_UUID 00000020:00000080:3.0:1788574310.449485:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79e97c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788574310.449492:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788574310.449577:0:13244:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2a547233-5b7a-4801-b1c0-26875afe1265->MGS 00010000:00010000:3.0:1788574310.449593:0:13244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574310.449607:0:13244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574310.449613:0:13244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788574310.449616:0:13244:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788574310.449619:0:13244:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788574310.449636:0:13244:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:3.0:1788574310.449639:0:13244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a780030200/0x10531a153b5356ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b5356f6 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574310.449654:0:13244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574310.449660:0:13244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574310.449679:0:13244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574310.449681:0:13244:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788574310.449683:0:13244:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788574310.449691:0:13244:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a78c8f3800 00010000:00010000:3.0:1788574310.449694:0:13244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b53593b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b535942 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788574310.449710:0:13244:0:(import.c:65:import_set_state_nolock()) ffff90a78c8f3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788574310.449714:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788574310.449716:0:13244:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788574310.449718:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788574310.449722:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788574310.449732:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7a788ea00 x1875455747644032/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788574311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788574310.449745:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788574310.449748:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:0.0:1788574310.450306:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79e97b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788574310.450597:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a547233-5b7a-4801-b1c0-26875afe1265:3311:1875455747644032:0@lo:250:kworker.0 10000000:01000000:3.0:1788574310.451860:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788574310.451881:0:13244:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5355d0 00000020:00000080:3.0:1788574310.451904:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a78c8f7000/2a547233-5b7a-4801-b1c0-26875afe1265 00000020:01000000:3.0:1788574310.451970:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.157@tcp (flags='') 00000020:00000080:3.0:1788574310.451983:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574310.451993:0:13244:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.157@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788574310.451998:0:13244:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90a792418000) has no exports 10000000:01000000:2.0:1788574310.452568:0:5854:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788574310.454099:0:13244:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.157@tcp: client import never connected 00000100:00080000:3.0:1788574310.454107:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788574310.454112:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788574310.454116:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788574310.454120:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788574310.460604:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78c8f7000/2a547233-5b7a-4801-b1c0-26875afe1265 for MGC192.168.201.157@tcp 00000020:00000080:3.0:1788574310.463299:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574310.463317:0:13244:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.157@tcp (uuid 2a547233-5b7a-4801-b1c0-26875afe1265) 00000020:01000000:3.0:1788574310.463328:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788574310.463356:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574310.463364:0:13244:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788574310.463396:0:13244:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90a7a773a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788574310.463404:0:13244:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff90a79241cd40) has exports, disconnecting them 00000020:00000080:0.0:1788574310.464075:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a78c8f3800 for MGC192.168.201.157@tcp 00000020:00000080:0.0:1788574310.464090:0:37:0:(genops.c:885:class_export_put()) final put ffff90a7b1b62000/2a547233-5b7a-4801-b1c0-26875afe1265 00000020:00000080:0.0:1788574310.464094:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7b1b62000/2a547233-5b7a-4801-b1c0-26875afe1265 for MGC192.168.201.157@tcp 00000020:01000000:0.0:1788574310.464102:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.157@tcp (2a547233-5b7a-4801-b1c0-26875afe1265) 00000020:00080000:3.0:1788574310.464938:0:13244:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90a7a773a800), last request at 1788574082 00000020:00000080:3.0:1788574310.464945:0:13244:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b535807 00000020:00080000:3.0:1788574310.464962:0:13244:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7a773a800): rc 0 00000020:00000080:3.0:1788574310.464968:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a7a773a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788574310.466294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7a773a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788574310.570489:0:13244:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788574310.570499:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574310.570504:0:13244:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788574310.570512:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574310.570754:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7a773a000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788574310.570799:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788574310.572691:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788574310.575432:0:6727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788574310.575868:0:5841:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90a7838eb400:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788574310.578187:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90a7838eb000:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788574310.578434:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.578726:0:5844:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90a79b0eec00:5844] 2 exiting: rc = 0 00000100:00100000:0.0:1788574310.578915:0:5843:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90a79b0ee200:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788574310.578996:0:5842:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90a79b0ee800:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1788574310.580183:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580194:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580200:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580207:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580212:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580218:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580225:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580231:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580236:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580242:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580247:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580253:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580258:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580266:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580275:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580281:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580287:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580292:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580296:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580318:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580324:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580329:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580335:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580341:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580347:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580353:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580388:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580395:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580402:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580408:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580414:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580598:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580624:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580630:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580636:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580641:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580647:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580652:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580657:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580663:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580668:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580674:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580679:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580685:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580691:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580696:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580702:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580708:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580713:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580718:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580723:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580728:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580734:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580739:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580751:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580756:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580761:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580766:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580771:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580776:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580781:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580786:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580791:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.580797:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788574310.598108:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574310.598127:0:13244:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788574310.598134:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a792313800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788574310.598138:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff90a792313800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788574310.598144:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788574310.598224:0:13244:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6812f6000 1 00000020:00000080:2.0:1788574310.598233:0:13244:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5357ac 00000020:00000080:2.0:1788574310.598242:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a7927e7800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788574310.598266:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788574310.598272:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574310.598277:0:13244:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788574310.598282:0:13244:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90a791dc99c0) has no exports 00000020:00000080:0.0:1788574310.598522:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7927e7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788574310.618138:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574310.618162:0:13244:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788574310.618170:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a6812f5000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788574310.618175:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6812f5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788574310.618200:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788574310.620669:0:13244:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a6812f1000 00000020:01000000:0.0:1788574310.620708:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788574310.620718:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574310.620724:0:13244:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574310.620729:0:13244:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90a79b180000) has no exports 00000020:00000080:0.0:1788574310.620764:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574310.620775:0:13244:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788574310.620781:0:13244:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d4000/OSS_uuid 00000020:00000080:0.0:1788574310.620785:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d4000/OSS_uuid for OSS 00000020:01000000:0.0:1788574310.620791:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788574310.622324:0:5853:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788574310.622920:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90a7a73eb800:6713] 2 exiting: rc = 0 00000100:00100000:1.0:1788574310.622974:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90a78e0c4600:6711] 0 exiting: rc = 1 00000100:00100000:1.0:1788574310.623028:0:10306:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90a7bfba7e00:10306] 3 exiting: rc = 0 00000100:00100000:1.0:1788574310.623091:0:12090:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff90a785e32e00:12090] 4 exiting: rc = 0 00000100:00100000:1.0:1788574310.623161:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90a7a02de800:6712] 1 exiting: rc = 0 00000100:00100000:0.0:1788574310.623916:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623927:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623933:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623941:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623946:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623952:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623958:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623963:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623968:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623973:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623979:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623984:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623989:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623994:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.623999:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624004:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624009:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624014:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624019:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624024:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624029:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624034:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624039:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624046:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624064:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624069:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624074:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624079:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624085:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624091:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624096:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624101:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624105:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624110:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624115:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624120:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624125:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624130:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624134:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624140:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624145:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624150:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624155:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624160:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624166:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624171:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624176:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624181:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624186:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624191:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624197:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624202:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624207:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624211:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624216:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624220:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624225:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624230:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624235:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624246:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624254:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624261:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624266:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.624270:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.625987:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90a7a02de000:6716] 1 exiting: rc = 0 00000100:00100000:1.0:1788574310.639097:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90a7a02de400:6714] 0 exiting: rc = 1 00000100:00100000:0.0:1788574310.639332:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639344:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639349:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639385:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639396:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639402:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639422:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639429:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639434:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639440:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639445:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639450:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639455:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639461:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639466:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639472:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639479:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639484:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639491:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639497:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639504:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639509:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639514:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639520:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639524:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639530:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639536:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639542:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639547:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639553:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639571:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639576:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639582:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639588:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639593:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639598:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639605:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639611:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639616:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639620:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639626:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639631:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639635:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639641:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639646:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639652:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639658:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639663:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639667:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639673:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639678:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639684:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639689:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639695:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639700:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639706:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639711:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639717:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639722:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639726:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639731:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639736:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639741:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.639753:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.640959:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90a78e0c4c00:6717] 0 exiting: rc = 1 00000100:00100000:0.0:1788574310.643792:0:6718:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90a7a73ea800:6718] 1 exiting: rc = 0 00000100:00100000:3.0:1788574310.644816:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90a7a73ea600:6719] 2 exiting: rc = 0 00000100:00100000:0.0:1788574310.645208:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645218:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645226:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645232:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645244:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645250:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645257:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645263:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645270:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645276:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645283:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645289:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645296:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645302:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645308:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645315:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645321:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645328:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645335:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645341:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645348:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645354:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645363:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645407:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645625:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645631:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645638:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645644:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645668:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645678:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645684:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645691:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645696:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645701:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645708:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645727:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645734:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645740:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645748:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645754:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645760:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645768:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645776:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645782:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645787:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645793:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645798:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645804:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645809:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645816:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645822:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645828:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645850:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645857:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645863:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645869:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645875:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645895:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645903:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645909:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645917:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645922:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.645927:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.646021:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.662596:0:6720:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90a793394200:6720] 0 exiting: rc = 1 00000100:00100000:0.0:1788574310.665844:0:6721:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90a793394c00:6721] 1 exiting: rc = 0 00000100:00100000:0.0:1788574310.666037:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666046:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666051:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666056:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666061:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666096:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666113:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666121:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666127:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666132:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666138:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666146:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666152:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666158:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666165:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666171:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666177:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666184:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666191:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666197:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666203:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666211:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666217:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666223:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666229:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666235:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666240:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666246:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666252:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666258:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666264:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666269:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666275:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666281:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666286:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666292:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666297:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666302:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666308:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666315:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666326:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666331:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666336:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666342:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666347:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666624:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666634:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666639:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666643:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666648:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666653:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666658:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666663:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666668:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666673:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666679:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666684:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666689:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666695:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666701:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666706:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666712:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666717:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.666722:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574310.670046:0:6723:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90a785147800:6723] 1 exiting: rc = 0 00000100:00100000:2.0:1788574310.671857:0:6722:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90a78e0c5200:6722] 0 exiting: rc = 1 00000100:00100000:2.0:1788574310.671969:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.671976:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.671983:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.671989:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.671995:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672001:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672019:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672025:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672031:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672037:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672052:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672058:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672064:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672070:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672076:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672082:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672089:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672095:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672101:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672107:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672113:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672118:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672154:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672161:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672167:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672173:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672181:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672187:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672193:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672200:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672208:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672215:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672220:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672226:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672245:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672251:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672257:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672263:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672270:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672277:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672283:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672293:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672300:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672315:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672323:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672329:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672335:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672342:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672387:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672396:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672403:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672726:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672736:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672742:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672749:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672755:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672761:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672766:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672772:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672779:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672784:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672790:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672804:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574310.672810:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788574310.712281:0:13244:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788574332.265289:0:13864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788574343.399126:0:14326:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788574343.399133:0:14326:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788574343.399236:0:14326:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a78528f000 00000020:01000004:2.0:1788574343.399248:0:14326:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788574343.399255:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788574343.399264:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90a793288000) 00000020:00000080:2.0:1788574343.399273:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788574343.423276:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788574343.431953:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788574343.433677:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 217: rc = 0 00100000:10000000:3.0:1788574343.433923:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 217: rc = 0 00100000:10000000:3.0:1788574343.434020:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 217: rc = 0 00100000:10000000:3.0:1788574343.434532:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788574343.434610:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 217: rc = 0 00100000:10000000:3.0:1788574343.434709:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 217: rc = 0 00100000:10000000:3.0:1788574343.434988:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 217: rc = 0 00100000:10000000:3.0:1788574343.435706:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 219: rc = 0 00100000:10000000:3.0:1788574343.437790:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 562: rc = 0 00100000:10000000:3.0:1788574343.438049:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 562: rc = 0 00100000:10000000:3.0:1788574343.438683:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 43: rc = 0 00100000:10000000:3.0:1788574343.440024:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 43: rc = 0 00100000:10000000:3.0:1788574343.440990:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 43: rc = 0 00100000:10000000:3.0:1788574343.442091:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 43: rc = 0 00100000:10000000:3.0:1788574343.442672:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 43: rc = 0 00100000:10000000:3.0:1788574343.443623:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 43: rc = 0 00100000:10000000:3.0:1788574343.448028:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 43: rc = 0 00100000:10000000:3.0:1788574343.448364:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 43: rc = 0 00100000:10000000:3.0:1788574343.448681:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 43: rc = 0 00100000:10000000:3.0:1788574343.448912:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 43: rc = 0 00100000:10000000:3.0:1788574343.449148:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 43: rc = 0 00100000:10000000:3.0:1788574343.449468:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 43: rc = 0 00100000:10000000:3.0:1788574343.449896:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 64: rc = 0 00100000:10000000:3.0:1788574343.450160:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 64: rc = 0 00100000:10000000:3.0:1788574343.450452:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 64: rc = 0 00100000:10000000:3.0:1788574343.450744:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 64: rc = 0 00100000:10000000:3.0:1788574343.450992:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 64: rc = 0 00100000:10000000:3.0:1788574343.451249:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 64: rc = 0 00100000:10000000:2.0:1788574343.458000:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 64: rc = 0 00100000:10000000:2.0:1788574343.458548:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 64: rc = 0 00100000:10000000:2.0:1788574343.458793:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 64: rc = 0 00100000:10000000:2.0:1788574343.459763:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 64: rc = 0 00100000:10000000:2.0:1788574343.460077:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 64: rc = 0 00100000:10000000:2.0:1788574343.461810:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 64: rc = 0 00100000:10000000:2.0:1788574343.462817:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 64: rc = 0 00100000:10000000:2.0:1788574343.466036:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 64: rc = 0 00100000:10000000:2.0:1788574343.468894:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 64: rc = 0 00100000:10000000:2.0:1788574343.469222:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 64: rc = 0 00100000:10000000:2.0:1788574343.469516:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 64: rc = 0 00100000:10000000:2.0:1788574343.469765:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 64: rc = 0 00100000:10000000:2.0:1788574343.470022:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 64: rc = 0 00100000:10000000:2.0:1788574343.471349:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 64: rc = 0 00100000:10000000:2.0:1788574343.475920:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 64: rc = 0 00100000:10000000:2.0:1788574343.476593:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 64: rc = 0 00100000:10000000:2.0:1788574343.476905:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 64: rc = 0 00100000:10000000:2.0:1788574343.477267:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 64: rc = 0 00100000:10000000:2.0:1788574343.479832:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 64: rc = 0 00100000:10000000:2.0:1788574343.481955:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 64: rc = 0 00100000:10000000:2.0:1788574343.483805:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 64: rc = 0 00100000:10000000:2.0:1788574343.488580:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 64: rc = 0 00100000:10000000:2.0:1788574343.488847:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 64: rc = 0 00100000:10000000:2.0:1788574343.489099:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 64: rc = 0 00100000:10000000:2.0:1788574343.489360:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 64: rc = 0 00100000:10000000:2.0:1788574343.489669:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 64: rc = 0 00100000:10000000:0.0:1788574343.490175:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 57: rc = 0 00100000:10000000:0.0:1788574343.490755:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788574343.490942:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 563: rc = 0 00100000:10000000:0.0:1788574343.491159:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788574343.491226:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 563: rc = 0 00100000:10000000:0.0:1788574343.491477:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788574343.491613:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 563: rc = 0 00100000:10000000:1.0:1788574343.491984:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788574343.492057:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:1.0:1788574343.492326:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788574343.492544:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:1.0:1788574343.493042:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788574343.493810:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 566: rc = 0 00000020:00000080:1.0:1788574343.496235:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788574343.496250:0:14326:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788574343.496271:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b5368d1 00000020:01000004:1.0:1788574343.496283:0:14326:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788574343.496288:0:14326:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788574343.496295:0:14326:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a78528f000 from MGS 00000020:01000004:1.0:1788574343.496299:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788574343.496310:0:14326:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90a7924b99c0) 00000020:00000080:1.0:1788574343.497082:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788574343.497169:0:14326:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a78528f000 from MGS, refs=2 00080000:01000000:1.0:1788574343.497177:0:14326:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788574343.497183:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b5368df 00000100:00100000:1.0:1788574343.498228:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788574343.498760:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788574343.498768:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788574343.517644:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788574343.517668:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788574343.518910:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574343.519095:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788574343.519101:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788574343.520573:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788574343.520594:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788574343.521567:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788574343.521577:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788574343.531790:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574343.531797:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574343.531800:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574343.532854:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574343.532859:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574343.532861:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574343.534819:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788574343.536939:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788574343.552150:0:14326:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788574343.552171:0:14326:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788574343.552180:0:14326:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788574343.554695:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788574343.554882:0:14326:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788574343.554992:0:14326:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788574343.558058:0:14326:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788574343.558389:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574343.558588:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788574343.558596:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788574343.562255:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788574343.562267:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788574343.563636:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788574343.563648:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788574343.564365:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788574343.564409:0:14326:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.157@tcp' 00000020:01000004:1.0:1788574343.564411:0:14326:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1788574343.564583:0:14340:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1788574343.564653:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.157@tcp (typ=mgc) 00000020:00000080:1.0:1788574343.564670:0:14326:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.157@tcp (ffff90a7924bcd40) 00000020:00000080:1.0:1788574343.564688:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788574343.564768:0:14326:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7bc13e800@MGC192.168.201.157@tcp: add connection 192.168.201.157@tcp at head 00010000:00010000:1.0:1788574343.568752:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.157@tcp-0 is initialized 00000040:01000000:1.0:1788574343.568764:0:14326:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788574343.571978:0:14341:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788574343.572081:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.157@tcp (uuid 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab) 00000020:00000080:1.0:1788574343.572114:0:14326:0:(genops.c:1385:class_connect()) connect: client 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab, cookie 0x10531a153b5368ed 00000100:00080000:1.0:1788574343.572133:0:14326:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574343.572141:0:14326:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import ffff90a7bc13e800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574343.572179:0:14326:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a7847100 x1875455747644288/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574343.572247:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3311:1875455747644288:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788574343.572515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574343.572585:0:14326:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS 00000020:01000004:1.0:1788574343.572606:0:14326:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788574343.572611:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788574343.572625:0:14326:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90a7924bb380) 00000020:00000080:1.0:1788574343.572637:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788574343.584148:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747644288 00000100:00100000:0.0:1788574343.584161:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747644288 00000100:00100000:0.0:1788574343.584209:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574343.584218:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875455747644288:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788574343.584244:0:14337:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1788574343.584271:0:14337:0:(genops.c:1385:class_connect()) connect: client 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab, cookie 0x10531a153b5368fb 00000100:00080000:0.0:1788574343.584433:0:14337:0:(import.c:65:import_set_state_nolock()) ffff90a7a7528000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574343.584539:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+5:3311:x1875455747644288:12345-0@lo:250:mount.lustre.0 Request processed in 321us (12023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.584548:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574343.584588:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788574343.584597:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.157@tcp: connect to target with instance 0 00000100:00080000:0.0:1788574343.584604:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788574343.584610:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788574343.584612:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bc13e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788574343.584615:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788574343.584624:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788574343.584628:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3311:1875455747644288:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788574343.594189:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574343.595134:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788574343.595141:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788574343.599189:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788574343.599211:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788574343.600334:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574343.600344:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788574343.604196:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574343.604433:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788574343.604439:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788574343.605365:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788574343.605418:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788574343.665265:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574343.665640:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788574343.665648:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788574343.667651:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788574343.667667:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788574343.668754:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574343.669331:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788574343.669337:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788574343.673749:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788574343.673766:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788574343.677740:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574343.678334:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788574343.678342:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788574343.679726:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788574343.679737:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788574343.681560:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574343.682045:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788574343.682054:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788574343.684053:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788574343.684070:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788574343.715249:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574343.715685:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788574343.715692:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788574343.723788:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574343.723802:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788574343.727013:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574343.727224:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788574343.729000:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788574343.729025:0:14326:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788574343.729031:0:14326:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788574343.729263:0:14326:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788574343.729294:0:14326:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788574343.729298:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788574343.729299:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788574343.729301:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574343.729302:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574343.729303:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574343.729304:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574343.729306:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574343.729307:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788574343.729309:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574343.729321:0:14326:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574343.729323:0:14326:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788574343.729325:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574343.729341:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788574343.729342:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574343.729343:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574343.729344:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574343.729345:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574343.729345:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574343.729346:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788574343.729347:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574343.729348:0:14326:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574343.730025:0:14326:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788574343.730058:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788574343.730282:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574343.730557:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7837cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574343.736075:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747644416 00000100:00100000:1.0:1788574343.736093:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747644416 00000100:00100000:1.0:1788574343.736291:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574343.736304:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+5:14326:x1875455747644416:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574343.736393:0:14339:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788574343.736397:0:14339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788574343.736401:0:14339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788574343.737457:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788574343.738522:0:14339:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788574343.740651:0:14361:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788574343.740662:0:14361:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788574343.740665:0:14361:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788574343.740699:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788574343.741659:0:14339:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788574343.741676:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788574343.757902:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+5:14326:x1875455747644416:12345-0@lo:253:mount.lustre.0 Request processed in 21590us (27610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.757928:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574343.758163:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788574343.758179:0:14326:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788574343.758182:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574343.758184:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788574343.758185:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574343.758186:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574343.758187:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574343.758189:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574343.758190:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574343.758191:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788574343.758193:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574343.758194:0:14326:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788574343.758218:0:14326:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a78528f000 from lustre-MDT0000 10000000:01000000:3.0:1788574343.758245:0:14326:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788574343.758248:0:14326:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788574343.758252:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a7924bcd40 10000000:01000000:3.0:1788574343.758257:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574343.758265:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a7924bcd40 from 1 10000000:01000000:3.0:1788574343.758268:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788574343.758337:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.758348:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.758358:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574343.758404:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574343.758453:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574343.758488:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7837cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.759399:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747644544 00000100:00100000:0.0:1788574343.759412:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747644544 00000100:00100000:0.0:1788574343.759468:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574343.759478:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+5:14326:x1875455747644544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574343.759491:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574343.759510:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2158200/0x10531a153b536909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536902 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.759537:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2158200/0x10531a153b536909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536902 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.759547:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2158200/0x10531a153b536909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536902 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.759556:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2158200, rc 0) 00000100:00100000:0.0:1788574343.759623:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+6:14326:x1875455747644544:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.759630:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574343.759797:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574343.759814:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.759823:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.759897:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574343.759939:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.759970:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.760712:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747644672 00000100:00100000:0.0:1788574343.760721:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747644672 00000100:00100000:0.0:1788574343.760754:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574343.760761:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+6:14326:x1875455747644672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574343.761254:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+6:14326:x1875455747644672:12345-0@lo:501:mount.lustre.0 Request processed in 490us (1313us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574343.761263:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574343.761781:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644672:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788574343.761820:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788574343.761838:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.761863:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574343.761872:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a78528f000 10000000:01000000:2.0:1788574343.761877:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788574343.761882:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a78528f000 10000000:01000000:2.0:1788574343.761885:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788574343.761889:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a78528f000 from 1 10000000:01000000:2.0:1788574343.761891:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788574343.761937:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.761945:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.761955:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.761974:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574343.762026:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.762063:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574343.762299:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747644800 00000100:00100000:3.0:1788574343.762305:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747644800 00000100:00100000:3.0:1788574343.762361:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574343.762393:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+6:14326:x1875455747644800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574343.762404:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574343.762417:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d7a00/0x10531a153b536917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536910 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.762437:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d7a00/0x10531a153b536917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536910 expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.762458:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d7a00/0x10531a153b536917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536910 expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.762468:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7a00, rc 0) 00000100:00100000:3.0:1788574343.762509:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+7:14326:x1875455747644800:12345-0@lo:101:mount.lustre.0 Request processed in 140us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574343.762515:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574343.762705:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574343.762719:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.762728:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574343.762754:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788574343.762758:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.762765:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574343.762772:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788574343.762776:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574343.762781:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a78528f000 10000000:01000000:2.0:1788574343.762784:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788574343.762787:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788574343.762789:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788574343.762808:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.762815:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.762823:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.762836:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574343.762873:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.762901:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574343.763341:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747644928 00000100:00100000:3.0:1788574343.763347:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747644928 00000100:00100000:3.0:1788574343.763412:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574343.763422:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+7:14326:x1875455747644928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574343.763432:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574343.763454:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d7600/0x10531a153b536925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53691e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.763472:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d7600/0x10531a153b536925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53691e expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.763481:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d7600/0x10531a153b536925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53691e expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.763488:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7600, rc 0) 00000100:00100000:3.0:1788574343.763530:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+8:14326:x1875455747644928:12345-0@lo:101:mount.lustre.0 Request processed in 110us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574343.763537:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574343.763703:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747644928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574343.763716:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.763733:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.763799:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747645056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574343.763827:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.763892:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574343.768009:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747645056 00000100:00100000:1.0:1788574343.768027:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747645056 00000100:00100000:1.0:1788574343.768110:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574343.768121:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+8:14326:x1875455747645056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574343.769087:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14326:x1875455747645056:12345-0@lo:501:mount.lustre.0 Request processed in 964us (5255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574343.769097:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574343.769481:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747645056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574343.769533:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747645184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574343.769582:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.769624:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.769680:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747645184 00000100:00100000:0.0:1788574343.769687:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747645184 00000100:00100000:0.0:1788574343.769731:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574343.769740:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14326:x1875455747645184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574343.770097:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14326:x1875455747645184:12345-0@lo:503:mount.lustre.0 Request processed in 358us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.770104:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574343.770353:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747645184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574343.771074:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14362:1875455747645312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574343.771123:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.771164:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574343.771268:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747645312 00000100:00100000:1.0:1788574343.771280:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747645312 00000100:00100000:1.0:1788574343.771329:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574343.771339:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14362:x1875455747645312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574343.771694:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14362:x1875455747645312:12345-0@lo:502:llog_process_th.0 Request processed in 356us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574343.771702:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574343.771958:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14362:1875455747645312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574343.771984:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574343.771995:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.771997:0:14362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788574343.772003:0:14362:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788574343.772006:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574343.772021:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90a7932899c0) 00000020:00000080:2.0:1788574343.772040:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788574343.772045:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788574343.772121:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788574343.772131:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b536933 00000020:00000080:2.0:1788574343.772539:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788574343.772544:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574343.772548:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.772549:0:14362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788574343.772552:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574343.772556:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.772557:0:14362:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788574343.772560:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574343.772567:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90a79328b380) 00000020:00000080:2.0:1788574343.772577:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788574343.772580:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788574343.772582:0:14362:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788574343.772585:0:14362:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788574343.772591:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574343.772639:0:14362:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a78528f000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788574343.772653:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90a79328cd40) 00000020:00000080:2.0:1788574343.772662:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788574343.772700:0:14362:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788574343.772711:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b536948 00000020:00000080:2.0:1788574343.772820:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788574343.772826:0:14362:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788574343.772830:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x10531a153b53694f 00080000:01000000:2.0:1788574343.772835:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788574343.772837:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b536956 00010000:00010000:3.0:1788574343.919246:0:14362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788574343.920234:0:14362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788574343.920614:0:14362:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788574343.921635:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90a791dcb380) 00000020:00000080:3.0:1788574343.921657:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788574343.921725:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788574343.921734:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b536964 00000020:00000080:3.0:1788574343.922286:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788574343.930939:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x10531a153b53696b 00000020:00000080:0.0:1788574343.931827:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788574343.931859:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574343.931869:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.931871:0:14362:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788574343.931874:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574343.931883:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.931885:0:14362:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788574343.931890:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788574343.931950:0:14362:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788574343.931967:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574343.931971:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.931973:0:14362:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788574343.932270:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788574343.932274:0:14362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788574343.932275:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574343.932276:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574343.932278:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788574343.932282:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.932283:0:14362:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788574343.932285:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574343.932288:0:14362:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788574343.932291:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.932292:0:14362:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788574343.932295:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788574343.932300:0:14362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:0.0:1788574343.932360:0:14362:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788574343.932364:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574343.932412:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a792418000) 00000020:00000080:0.0:1788574343.932429:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788574343.932434:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788574343.932514:0:14362:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788574343.932520:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788574343.932527:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b536979 00010000:00080000:0.0:1788574343.932583:0:14362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a791da2800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788574343.933460:0:14362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788574343.935217:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788574343.935279:0:14362:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788574343.938066:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574343.938147:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788574343.938216:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788574343.941555:0:14366:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788574343.941566:0:14366:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788574343.942650:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574343.942667:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788574343.942711:0:14362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788574343.942733:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b536980 00000100:00080000:2.0:1788574343.942746:0:14362:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574343.942754:0:14362:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a791da2800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574343.942809:0:14362:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7933b9500 x1875455747645440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574343.944341:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747645440:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788574343.944422:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747645440 offset 0 length 520: 4 00000100:00080000:2.0:1788574343.944520:0:14362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788574343.944618:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574343.944625:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.944627:0:14362:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788574343.944630:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788574343.944633:0:14362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788574343.944635:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574343.944637:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574343.944638:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788574343.944641:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.944642:0:14362:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788574343.944645:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574343.944651:0:14362:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788574343.944654:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.944655:0:14362:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788574343.944658:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574343.944663:0:14362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:2.0:1788574343.944684:0:14362:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788574343.944686:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574343.944721:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a79f8fb380) 00000020:00000080:2.0:1788574343.944744:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788574343.944749:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788574343.945335:0:14362:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788574343.945343:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788574343.945352:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b53698e 00010000:00080000:2.0:1788574343.945416:0:14362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a791d0f800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788574343.945658:0:14362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788574343.945895:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788574343.945917:0:14362:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788574343.953121:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574343.953648:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788574343.953765:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788574343.955428:0:14368:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788574343.955435:0:14368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788574343.956634:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747645568:0@lo:400:kworker.0 00000100:00100000:3.0:1788574343.956704:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.956804:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747645568 00000100:00100000:1.0:1788574343.956813:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747645568 00000100:00100000:1.0:1788574343.956872:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574343.956883:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:3314:x1875455747645568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574343.956949:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:3314:x1875455747645568:12345-0@lo:400:kworker.0 Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574343.956957:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1788574343.960222:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574343.960242:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788574343.960294:0:14362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788574343.960325:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b536995 00000100:00080000:2.0:1788574343.960336:0:14362:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574343.960343:0:14362:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a791d0f800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574343.960415:0:14362:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7933b9c00 x1875455747645696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574343.960435:0:14362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788574343.960733:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747645696:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788574343.960807:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747645696 offset 0 length 520: 4 00000020:01000000:2.0:1788574343.961222:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574343.961227:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.961229:0:14362:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788574343.961232:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574343.961236:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.961237:0:14362:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574343.961240:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574343.961242:0:14362:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574343.961244:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574343.961246:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.961247:0:14362:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788574343.961250:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574343.961252:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.961253:0:14362:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788574343.961256:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788574343.961287:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14362:1875455747645824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574343.961355:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.961398:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.961474:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747645824 00000100:00100000:0.0:1788574343.961482:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747645824 00000100:00100000:0.0:1788574343.961530:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574343.961541:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14362:x1875455747645824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574343.962203:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14362:x1875455747645824:12345-0@lo:502:llog_process_th.0 Request processed in 661us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.962212:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574343.963393:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14362:1875455747645824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574343.963541:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574343.963548:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574343.963550:0:14362:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788574343.963556:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788574343.963730:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788574343.963755:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788574343.963789:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.963801:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574343.963809:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a78528f000 from 1 10000000:01000000:0.0:1788574343.963812:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574343.964212:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.964222:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.964232:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574343.964255:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747645952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574343.966564:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.966626:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574343.967090:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747645952 00000100:00100000:2.0:1788574343.967110:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747645952 00000100:00100000:2.0:1788574343.967555:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574343.967565:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+9:14326:x1875455747645952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574343.967582:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574343.967603:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53699c expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.967628:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53699c expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.967638:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53699c expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.967646:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984800, rc 0) 00000100:00100000:2.0:1788574343.967714:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+10:14326:x1875455747645952:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.967721:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574343.967899:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747645952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574343.968077:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574343.968087:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574343.968825:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646080:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788574343.971293:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.972269:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574343.972978:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747645568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574343.977072:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646080 00000100:00100000:2.0:1788574343.977087:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646080 00000100:00100000:2.0:1788574343.977357:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574343.977383:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+10:14326:x1875455747646080:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788574343.977416:0:14339:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788574343.977423:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788574343.977565:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+10:14326:x1875455747646080:12345-0@lo:256:mount.lustre.0 Request processed in 199us (6277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.977586:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574343.977686:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646080:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788574343.978281:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574343.978320:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.978333:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574343.978437:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a78528f000 from 1 10000000:01000000:0.0:1788574343.978440:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574343.978482:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.978490:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.978501:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574343.978526:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574343.978581:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.979064:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646208 00000100:00100000:1.0:1788574343.979071:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646208 00000100:00100000:1.0:1788574343.979160:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574343.979169:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+10:14326:x1875455747646208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574343.979189:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574343.979204:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5369aa expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574343.979228:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5369aa expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574343.979240:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369aa expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574343.979251:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfb08400, rc 0) 00000100:00100000:1.0:1788574343.979297:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747646208:12345-0@lo:101:mount.lustre.0 Request processed in 130us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574343.979304:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574343.979723:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574343.979743:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574343.979758:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574343.979769:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574343.979838:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574343.979865:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.979888:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574343.980034:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646336 00000100:00100000:2.0:1788574343.980040:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646336 00000100:00100000:2.0:1788574343.980073:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574343.980081:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747646336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574343.980841:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747646336:12345-0@lo:501:mount.lustre.0 Request processed in 759us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.980850:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574343.981232:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574343.981268:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574343.981320:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.981408:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574343.981478:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646464 00000100:00100000:2.0:1788574343.981484:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646464 00000100:00100000:2.0:1788574343.981553:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574343.981560:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747646464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574343.981726:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747646464:12345-0@lo:503:mount.lustre.0 Request processed in 166us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.981733:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574343.981805:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574343.982340:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14370:1875455747646592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574343.982397:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.982641:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646592 00000100:00100000:1.0:1788574343.982647:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646592 00000100:00100000:2.0:1788574343.982695:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574343.982704:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14370:x1875455747646592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574343.982898:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14370:x1875455747646592:12345-0@lo:502:llog_process_th.0 Request processed in 195us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.982905:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574343.982974:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e7f86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.982991:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14370:1875455747646592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574343.983014:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574343.983023:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.983026:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788574343.983033:0:14370:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a78528f000 00000020:00000080:0.0:1788574343.983036:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574343.983044:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574343.983047:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.983048:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788574343.983050:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574343.983053:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.983054:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788574343.983058:0:14370:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a78528f000 00000020:00000080:0.0:1788574343.983060:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574343.983241:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574343.983250:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.983252:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788574343.983254:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574343.983257:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.983258:0:14370:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788574343.983262:0:14370:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a78528f000 00000020:00000080:0.0:1788574343.983264:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788574343.983301:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14370:1875455747646720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574343.983349:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.983394:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646720 00000100:00100000:0.0:1788574343.983399:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646720 00000100:00100000:0.0:1788574343.983419:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574343.983424:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14370:x1875455747646720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574343.983547:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14370:x1875455747646720:12345-0@lo:502:llog_process_th.0 Request processed in 122us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.983553:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574343.983580:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.983591:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14370:1875455747646720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574343.983608:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574343.983612:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574343.983613:0:14370:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788574343.983616:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788574343.983670:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788574343.983691:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574343.983704:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.983716:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574343.983764:0:14326:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788574343.983767:0:14326:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a78528f000 10000000:01000000:0.0:1788574343.983770:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a78528f000 10000000:01000000:0.0:1788574343.983775:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574343.983780:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a78528f000 from 1 10000000:01000000:0.0:1788574343.983782:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574343.983808:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.983816:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.983827:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574343.983839:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574343.983868:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.983881:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.983895:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646848 00000100:00100000:0.0:1788574343.983898:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646848 00000100:00100000:0.0:1788574343.987493:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574343.987518:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747646848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574343.987545:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574343.987572:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159200/0x10531a153b5369bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5369b8 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.987607:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159200/0x10531a153b5369bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5369b8 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.987633:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159200/0x10531a153b5369bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369b8 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.987643:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159200, rc 0) 00000100:00100000:0.0:1788574343.987746:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14326:x1875455747646848:12345-0@lo:101:mount.lustre.0 Request processed in 239us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.987752:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574343.987825:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574343.987847:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.987859:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574343.987945:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574343.987980:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.988015:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.988030:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747646976 00000100:00100000:0.0:1788574343.988036:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747646976 00000100:00100000:0.0:1788574343.988063:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574343.988069:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14326:x1875455747646976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574343.988478:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14326:x1875455747646976:12345-0@lo:501:mount.lustre.0 Request processed in 407us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.988487:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574343.988521:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747646976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574343.988557:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747647104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574343.988593:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.988606:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.988619:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647104 00000100:00100000:0.0:1788574343.988622:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647104 00000100:00100000:0.0:1788574343.988639:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574343.988645:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14326:x1875455747647104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574343.988784:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14326:x1875455747647104:12345-0@lo:503:mount.lustre.0 Request processed in 138us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.988791:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574343.988827:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747647104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574343.989748:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14373:1875455747647232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574343.989792:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574343.989827:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.989866:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647232 00000100:00100000:0.0:1788574343.989871:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647232 00000100:00100000:0.0:1788574343.989903:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788574343.989911:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14373:x1875455747647232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574343.990440:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14373:x1875455747647232:12345-0@lo:502:llog_process_th.0 Request processed in 529us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.990448:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574343.999063:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14373:1875455747647232:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788574343.999179:0:14373:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788574343.999198:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90a7924b8000) 00000020:00000080:1.0:1788574343.999221:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788574343.999333:0:14373:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a78528f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788574343.999338:0:14373:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a78528f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788574343.999341:0:14373:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a78528f000 4 00010000:00080000:1.0:1788574343.999389:0:14373:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a785314800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:1.0:1788574344.004896:0:14373:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788574344.012989:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788574344.018018:0:14373:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574344.018046:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x10531a153b5369cd 00000100:00080000:1.0:1788574344.018062:0:14373:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574344.018071:0:14373:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a785314800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574344.018121:0:14373:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a7845c00 x1875455747647360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574344.018150:0:14373:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788574344.020035:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747647360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788574344.021166:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574344.021251:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647360 00000100:00100000:3.0:1788574344.021259:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647360 00000100:00100000:3.0:1788574344.021297:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574344.021314:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747647360:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788574344.022071:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747647360:12345-0@lo:38:llog_process_th.0 Request processed in 763us (907us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788574344.022081:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574344.022488:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574344.022498:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a785314800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574344.022503:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788574344.022507:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747647360:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574344.022732:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14373:1875455747647488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574344.022788:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574344.022822:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647488 00000100:00100000:1.0:1788574344.022828:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647488 00000100:00100000:1.0:1788574344.022870:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574344.022878:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14373:x1875455747647488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574344.024720:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14373:x1875455747647488:12345-0@lo:502:llog_process_th.0 Request processed in 1834us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574344.024734:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574344.024810:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574344.024843:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14373:1875455747647488:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788574344.024885:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788574344.028753:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788574344.028799:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574344.028822:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574344.028836:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788574344.028907:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788574344.029010:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574344.029013:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574344.029014:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574344.029015:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574344.029017:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574344.029018:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574344.029019:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574344.029021:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574344.029022:0:14326:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574344.029026:0:14326:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788574344.029029:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574344.029030:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574344.029031:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574344.029032:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574344.029033:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574344.029034:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574344.029035:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574344.029036:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574344.029037:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574344.029038:0:14326:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574344.029069:0:14326:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788574344.029241:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747647616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574344.029327:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574344.029501:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574344.031173:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647616 00000100:00100000:1.0:1788574344.031188:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647616 00000100:00100000:1.0:1788574344.031593:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574344.031606:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14326:x1875455747647616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574344.031640:0:14339:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788574344.031653:0:14339:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788574344.126742:0:14339:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788574344.126760:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788574344.126825:0:14360:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788574344.126830:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788574344.126861:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.126883:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53699c expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.126892:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.127056:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53699c expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.127088:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53699c expref: 12 pid: 14338 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574344.127174:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1875455747647744:0@lo:104: 00000100:00100000:1.0:1788574344.127244:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574344.127315:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574344.127412:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647744 00000100:00100000:3.0:1788574344.127421:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647744 00000100:00100000:3.0:1788574344.127470:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574344.127479:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14360:x1875455747647744:12345-0@lo:104: 00010000:00010000:3.0:1788574344.127493:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574344.127631:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574344.127638:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14360:x1875455747647744:12345-0@lo:104: Request processed in 161us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574344.127645:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788574344.127776:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574344.127783:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.127790:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574344.127794:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.127802:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574344.127809:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574344.127814:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574344.127982:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.127989:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574344.128010:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128017:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b53699c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369a3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128045:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574344.128047:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574344.128049:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574344.128061:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747647872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574344.128166:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574344.128228:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747647872 00000100:00100000:1.0:1788574344.128233:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747647872 00010000:00010000:1.0:1788574344.128251:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53699c expref: 13 pid: 14338 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574344.128270:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574344.128277:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+13:3315:x1875455747647872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574344.128287:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574344.128292:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53699c expref: 13 pid: 14338 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128302:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53699c expref: 13 pid: 14338 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128329:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128338:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788574344.128352:0:14329:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001522738s 00010000:00010000:1.0:1788574344.128357:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128411:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128418:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128425:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128430:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574344.128434:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128442:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128451:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.128461:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574344.128491:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+13:3315:x1875455747647872:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574344.128498:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574344.128537:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747647872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574344.129010:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e984800/0x10531a153b5369a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53699c expref: 12 pid: 14338 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574344.129022:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1875455747647744:0@lo:104: 00010000:00010000:1.0:1788574344.129036:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.129049:0:14360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.129055:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574344.129062:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfb09800/0x10531a153b5369d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574344.144635:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14326:x1875455747647616:12345-0@lo:253:mount.lustre.0 Request processed in 113021us (115296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574344.144651:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574344.146575:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14326:1875455747647616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788574344.146597:0:14326:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788574344.146600:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574344.146602:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574344.146603:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574344.146618:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574344.146619:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574344.146621:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574344.146623:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574344.146624:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574344.146627:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574344.146628:0:14326:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788574344.146646:0:14326:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788574344.158719:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788574344.159013:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574344.162895:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574344.163611:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574344.165280:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574344.165540:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788574344.171080:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574344.171258:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788574344.171581:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574344.171810:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788574344.172056:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574344.172202:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788574344.280134:0:14326:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788574344.282511:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788574344.283072:0:14383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788574344.283192:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788574344.285479:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788574344.285612:0:14326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788574344.287516:0:14382:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788574344.287528:0:14382:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1788574344.289571:0:14326:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:3.0:1788574344.291426:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788574344.291527:0:14383:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788574344.291532:0:14383:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788574344.296722:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788574344.297350:0:14326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574344.299474:0:14326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788574344.300525:0:14326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788574344.300990:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788574344.305191:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788574344.319047:0:14326:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788574344.371692:0:14326:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788574344.371734:0:14326:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3a24199f988 00100000:10000000:0.0:1788574344.371743:0:14326:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788574344.372965:0:14326:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574344.372983:0:14326:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574344.372996:0:14326:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788574344.373011:0:14326:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788574344.576589:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574345.089434:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788574345.536447:0:14341:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574345.536454:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a78528f000 from 6 10000000:01000000:0.0:1788574345.536459:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574345.536501:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574345.536511:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574345.536523:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574345.536546:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747648000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574345.536610:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574345.536655:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574345.536955:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747648000 00000100:00100000:3.0:1788574345.536963:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747648000 00000100:00100000:3.0:1788574345.537000:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574345.537008:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14341:x1875455747648000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574345.537020:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574345.537032:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5369db expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574345.537054:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5369db expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574345.537064:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369db expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574345.537073:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7400, rc 0) 00000100:00100000:3.0:1788574345.537111:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747648000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574345.537127:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574345.537181:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747648000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574345.537195:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574345.537203:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574345.537250:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747648128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574345.537278:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574345.537309:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793221a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574345.537348:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747648128 00000100:00100000:0.0:1788574345.537352:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747648128 00000100:00100000:0.0:1788574345.537391:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574345.537397:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747648128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788574345.537412:0:14339:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574345.537430:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574345.537434:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788574345.537506:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747648128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574345.537520:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574345.537763:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747648128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574345.537801:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574345.538640:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574345.538653:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574345.603668:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574346.119965:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574346.624580:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574347.653996:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574348.675530:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574349.441550:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574349.441561:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574349.441564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574349.441568:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574349.441571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788574349.441575:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788574349.441582:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a785314800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574349.441613:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a785314800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574349.441646:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a7847480 x1875455747648384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574349.441812:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747648256:0@lo:400:kworker.0 00000100:00100000:1.0:1788574349.441982:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574349.442055:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747648384:0@lo:38:kworker.0 00000100:00100000:1.0:1788574349.442088:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574349.442134:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747648256 00000100:00100000:1.0:1788574349.442142:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747648256 00000100:00100000:1.0:1788574349.442187:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574349.442195:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3312:x1875455747648256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574349.443530:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3312:x1875455747648256:12345-0@lo:400:kworker.0 Request processed in 1328us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574349.443542:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574349.443615:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747648384 00000100:00100000:1.0:1788574349.443621:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747648384 00000100:00100000:1.0:1788574349.443651:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574349.443657:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875455747648384:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788574349.443689:0:14346:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1788574349.443735:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x10531a153b5369e9 00000004:00100000:1.0:1788574349.444935:0:14346:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788574349.445121:0:14346:0:(import.c:65:import_set_state_nolock()) ffff90a7bba11800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574349.445231:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875455747648384:12345-0@lo:38:kworker.0 Request processed in 1571us (3140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574349.445241:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574349.445789:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7a7847480 x1875455747648384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574349.445815:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788574349.445956:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788574349.445963:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788574349.445967:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a785314800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788574349.445987:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747648384:0@lo:38:kworker.0 00000100:00100000:2.0:1788574349.446035:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747648256:0@lo:400:kworker.0 00010000:00010000:1.0:1788574349.697201:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574350.721054:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574350.869971:0:14626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788574351.744613:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574352.775959:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574353.536659:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574343/real 1788574343] req@ffff90a7933b9c00 x1875455747645696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574353.536698:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7933b9c00 x1875455747645696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574353.536737:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574343/real 1788574343] req@ffff90a7933b9500 x1875455747645440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574353.536751:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7933b9500 x1875455747645440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574353.536770:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574353.536794:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788574353.536798:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747645696:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788574353.536804:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574353.536809:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788574353.536812:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747645440:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788574353.538465:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574353.538471:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788574353.538475:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574353.538484:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:2.0:1788574353.538490:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574353.538499:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a791da2800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574353.538526:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7933ba300 x1875455747648640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574353.538541:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574353.538544:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574353.538546:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574353.538549:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:2.0:1788574353.538552:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574353.538555:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a791d0f800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574353.538564:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7933b9f80 x1875455747648768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574353.538611:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747648512:0@lo:400:kworker.0 00000100:00100000:2.0:1788574353.538721:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574353.538858:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747648512 00000100:00100000:3.0:1788574353.538867:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747648512 00000100:00100000:3.0:1788574353.538921:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574353.538931:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3313:x1875455747648512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574353.538991:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3313:x1875455747648512:12345-0@lo:400:kworker.0 Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574353.538998:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574353.539048:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747648512:0@lo:400:kworker.0 00000100:00100000:3.0:1788574353.539072:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747648640:0@lo:8:kworker.0 00000400:00000100:3.0:1788574353.539100:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747648640 offset 0 length 520: 4 00000100:00100000:3.0:1788574353.539112:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747648768:0@lo:8:kworker.0 00000400:00000100:3.0:1788574353.539130:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747648768 offset 0 length 520: 4 00000100:00100000:1.0:1788574353.540073:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747648896:0@lo:400:kworker.0 00000100:00100000:1.0:1788574353.540129:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574353.540429:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747648896 00000100:00100000:3.0:1788574353.540440:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747648896 00000100:00100000:3.0:1788574353.540488:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574353.540497:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747648896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574353.540558:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747648896:12345-0@lo:400:kworker.0 Request processed in 62us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574353.540564:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788574353.542497:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7933b9880 x1875455747648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574353.542525:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747648896:0@lo:400:kworker.0 00010000:00010000:3.0:1788574353.793040:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574354.442999:0:14776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe857ac20 20000000:00000080:3.0:1788574354.443028:0:14776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a79fb53c00 uarg=0000000000000000 20000000:01000000:3.0:1788574354.443095:0:14776:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788574354.443104:0:14776:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788574354.443111:0:14776:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788574354.456224:0:14777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788574354.456602:0:14776:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788574354.472704:0:14776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574354.472748:0:14776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574354.472774:0:14776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369aa expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574354.472782:0:14776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574354.472846:0:14776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5369aa expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574354.472865:0:14776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5369aa expref: 11 pid: 14338 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574354.472884:0:14776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14776:1875455747649024:0@lo:104: 00000100:00100000:1.0:1788574354.472968:0:14776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574354.473037:0:14776:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574354.473355:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649024 00000100:00100000:0.0:1788574354.473395:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649024 00000100:00100000:0.0:1788574354.473464:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574354.473476:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14776:x1875455747649024:12345-0@lo:104: 00010000:00010000:0.0:1788574354.473507:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.473585:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574354.473591:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14776:x1875455747649024:12345-0@lo:104: Request processed in 119us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574354.473597:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788574354.473619:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574354.473626:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.473634:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2158400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:0.0:1788574354.473639:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.473647:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574354.473795:0:14776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14776:1875455747649024:0@lo:104: 00010000:00010000:2.0:1788574354.473847:0:14776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574354.474646:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574354.474677:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788574354.474728:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.474736:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574354.474768:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.474776:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369b1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.474793:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574354.474795:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574354.474796:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574354.474889:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574354.474908:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747649152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574354.474962:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.475139:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649152 00000100:00100000:0.0:1788574354.475147:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649152 00010000:00010000:0.0:1788574354.475181:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5369aa expref: 12 pid: 14338 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574354.475215:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574354.475222:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3314:x1875455747649152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574354.475233:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574354.475238:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5369aa expref: 12 pid: 14338 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475250:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5369aa expref: 12 pid: 14338 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475264:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfb08400/0x10531a153b5369b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5369aa expref: 12 pid: 14338 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475289:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475297:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475312:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475319:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475326:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475332:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475337:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574354.475342:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.475350:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574354.480743:0:14776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574354.480772:0:14776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.483810:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.483839:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfb09c00/0x10531a153b5369f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574354.483881:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574354.484016:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:3314:x1875455747649152:12345-0@lo:103:ldlm_bl.0 Request processed in 8789us (9048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574354.484027:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574354.484219:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747649152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574354.816560:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788574355.592556:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574355.592567:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a78528f000 from 10 10000000:01000000:0.0:1788574355.592575:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574355.592633:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574355.592646:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574355.592660:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574355.592694:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747649280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574355.592787:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574355.593327:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574355.593351:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649280 00000100:00100000:0.0:1788574355.593358:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649280 00000100:00100000:0.0:1788574355.593438:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574355.593448:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+11:14341:x1875455747649280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574355.593464:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574355.593482:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5369f7 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574355.593508:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5369f7 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574355.593531:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369f7 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574355.593543:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159400, rc 0) 00000100:00100000:0.0:1788574355.593592:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747649280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574355.593598:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574355.594596:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747649280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574355.594619:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574355.594630:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574355.594720:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747649408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574355.594768:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574355.594810:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574355.595418:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649408 00000100:00100000:3.0:1788574355.595427:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649408 00000100:00100000:3.0:1788574355.595475:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574355.595483:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747649408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574355.595786:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747649408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574355.595793:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574355.596043:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747649408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574355.596085:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747649536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574355.596139:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574355.596171:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574355.596434:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649536 00000100:00100000:3.0:1788574355.596440:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649536 00000100:00100000:3.0:1788574355.596479:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574355.596485:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747649536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574355.596645:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:14341:x1875455747649536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574355.596652:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574355.597181:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747649536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788574355.601726:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788574355.602231:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788574355.602264:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574355.602282:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574355.602298:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574355.844655:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574356.353245:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788574356.864507:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574357.899328:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574358.658488:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574358.658497:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574358.658500:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574358.658503:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574358.658540:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747649664:0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.658612:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574358.658665:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574358.658671:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747649792:0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.658698:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574358.658737:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649664 00000100:00100000:2.0:1788574358.658745:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649664 00000100:00100000:2.0:1788574358.658790:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574358.658799:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3312:x1875455747649664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.658849:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:3312:x1875455747649664:12345-0@lo:400:kworker.0 Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574358.658870:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574358.658907:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649792 00000100:00100000:2.0:1788574358.658912:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649792 00000100:00100000:2.0:1788574358.658938:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574358.658944:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747649792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.658975:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747649792:12345-0@lo:400:kworker.0 Request processed in 31us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574358.658981:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574358.659020:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7933baa00 x1875455747649792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.659035:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747649792:0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.659044:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747649664:0@lo:400:kworker.0 00010000:00010000:3.0:1788574358.912525:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574359.936600:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788574360.523093:0:15026:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788574360.523098:0:15026:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788574360.523210:0:15026:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7bfbe1000 00000020:01000004:2.0:1788574360.523226:0:15026:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788574360.523238:0:15026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788574360.523250:0:15026:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a79f8fcd40) 00000020:00000080:2.0:1788574360.523272:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788574360.570252:0:15026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788574360.570607:0:15026:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788574360.572363:0:15026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788574360.573302:0:15026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788574360.575182:0:15026:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788574360.576312:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 107: rc = 0 00100000:10000000:1.0:1788574360.579247:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 107: rc = 0 00100000:10000000:1.0:1788574360.579835:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 107: rc = 0 00100000:10000000:1.0:1788574360.581295:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1788574360.582215:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788574360.585103:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1788574360.585457:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788574360.587152:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788574360.589336:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00000020:00000080:1.0:1788574360.590058:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788574360.590071:0:15026:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788574360.590082:0:15026:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x10531a153b536a0c 00000020:01000004:1.0:1788574360.590091:0:15026:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788574360.590116:0:15026:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788574360.590119:0:15026:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788574360.590126:0:15026:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788574360.590129:0:15026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788574360.590142:0:15026:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a7a745cd40) 00000020:00000080:1.0:1788574360.590155:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788574360.603432:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574360.603672:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788574360.603680:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788574360.604559:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574360.604570:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788574360.607259:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574360.607277:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788574360.609931:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574360.610701:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574360.610710:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788574360.613657:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788574360.613674:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788574360.646937:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574360.647280:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788574360.647287:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788574360.650934:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574360.650953:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788574360.656275:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788574360.656291:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788574360.658281:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574360.658538:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574360.658544:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788574360.660746:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574360.660763:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788574360.742571:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574360.743946:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574360.743960:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788574360.749791:0:15026:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788574360.749808:0:15026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788574360.756559:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788574360.756589:0:15026:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788574360.756595:0:15026:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788574360.780361:0:15026:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788574360.780759:0:15026:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788574360.780763:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788574360.780765:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574360.780766:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574360.780767:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574360.780768:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574360.780769:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574360.780770:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574360.780771:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574360.780772:0:15026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574360.780776:0:15026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788574360.780777:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574360.780778:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574360.780778:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574360.780779:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574360.780780:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574360.780780:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574360.780781:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574360.780781:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574360.780786:0:15026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574360.780814:0:15026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788574360.780832:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747649920:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574360.780899:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574360.781112:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574360.781408:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747649920 00000100:00100000:1.0:1788574360.781417:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747649920 00000100:00100000:1.0:1788574360.781489:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574360.781499:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:15026:x1875455747649920:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574360.781543:0:14337:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788574360.781547:0:14337:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788574360.781566:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788574360.791485:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:15026:x1875455747649920:12345-0@lo:253:mount.lustre.0 Request processed in 9964us (10562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574360.791507:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574360.791642:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747649920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574360.791661:0:15026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788574360.791665:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574360.791667:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574360.791669:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574360.791670:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574360.791671:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574360.791673:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574360.791674:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574360.791677:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574360.791678:0:15026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574360.791703:0:15026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7bfbe1000 from lustre-OST0000 10000000:01000000:0.0:1788574360.791733:0:15026:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788574360.791736:0:15026:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788574360.791744:0:15026:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a7924bcd40 local copy 00010000:00010000:0.0:1788574360.791757:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574360.792490:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574360.792540:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574360.792586:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574360.792598:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650048 00000100:00100000:2.0:1788574360.792605:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650048 00000100:00100000:2.0:1788574360.792664:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788574360.792673:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:15026:x1875455747650048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574360.792801:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:15026:x1875455747650048:12345-0@lo:501:mount.lustre.0 Request processed in 128us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574360.792809:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574360.792833:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650048:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788574360.792846:0:15026:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788574360.793182:0:15026:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788574360.793190:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793206:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574360.793227:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7bfbe1000 10000000:01000000:0.0:1788574360.793232:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788574360.793236:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a7924bcd40 10000000:01000000:0.0:1788574360.793239:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788574360.793242:0:15026:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a7924bcd40 from 1 10000000:01000000:0.0:1788574360.793245:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788574360.793273:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793282:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793293:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574360.793308:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574360.793350:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574360.793467:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574360.793512:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650176 00000100:00100000:1.0:1788574360.793518:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650176 00000100:00100000:1.0:1788574360.793547:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574360.793556:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+12:15026:x1875455747650176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574360.793567:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574360.793581:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfb08200/0x10531a153b536a21 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536a1a expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.793607:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfb08200/0x10531a153b536a21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536a1a expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.793619:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfb08200/0x10531a153b536a21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a1a expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.793629:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfb08200, rc 0) 00000100:00100000:1.0:1788574360.793714:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+13:15026:x1875455747650176:12345-0@lo:101:mount.lustre.0 Request processed in 158us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574360.793720:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788574360.793784:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574360.793798:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793807:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574360.793840:0:15026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788574360.793895:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793903:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574360.793910:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788574360.793914:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574360.793918:0:15026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788574360.793921:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574360.793948:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793955:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.793964:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574360.793978:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574360.794005:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574360.794034:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783d49180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574360.794089:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650304 00000100:00100000:3.0:1788574360.794094:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650304 00000100:00100000:3.0:1788574360.794129:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574360.794136:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+13:15026:x1875455747650304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574360.794143:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574360.794153:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d7e00/0x10531a153b536a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536a28 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.794167:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d7e00/0x10531a153b536a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536a28 expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.794176:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d7e00/0x10531a153b536a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a28 expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.794182:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7e00, rc 0) 00000100:00100000:3.0:1788574360.794304:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650304:12345-0@lo:101:mount.lustre.0 Request processed in 169us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574360.794309:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574360.795177:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574360.795199:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.795209:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574360.796708:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788574360.797677:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574360.797955:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788574360.798012:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788574360.798064:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788574360.798113:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788574360.798151:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788574360.798185:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788574360.798252:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788574360.798260:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788574360.798350:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574360.798474:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.798515:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a791f80480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574360.798781:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650432 00000100:00100000:1.0:1788574360.798793:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650432 00000100:00100000:1.0:1788574360.798860:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574360.798871:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574360.799529:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650432:12345-0@lo:501:mount.lustre.0 Request processed in 658us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574360.799617:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574360.799878:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574360.799924:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574360.799974:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574360.800061:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650560 00000100:00100000:3.0:1788574360.800067:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650560 00000100:00100000:2.0:1788574360.800075:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a791f80480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574360.800099:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788574360.800107:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574360.800561:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650560:12345-0@lo:503:mount.lustre.0 Request processed in 454us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574360.800568:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574360.800849:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574360.802751:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574360.803519:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574360.803678:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.803730:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ace40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574360.803825:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650688 00000100:00100000:1.0:1788574360.803833:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650688 00000100:00100000:1.0:1788574360.804129:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574360.804140:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574360.804489:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650688:12345-0@lo:502:mount.lustre.0 Request processed in 350us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574360.804497:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574360.804609:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574360.804846:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788574360.804887:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788574360.804919:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788574360.804994:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788574360.805045:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788574360.805080:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788574360.805133:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788574360.805174:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788574360.805214:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788574360.805262:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788574360.805301:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788574360.805351:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788574360.805454:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574360.805508:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574360.805554:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574360.805732:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650816 00000100:00100000:2.0:1788574360.805740:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650816 00000100:00100000:2.0:1788574360.805790:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574360.805800:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574360.805985:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650816:12345-0@lo:502:mount.lustre.0 Request processed in 187us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574360.805993:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574360.806214:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574360.806286:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788574360.806296:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788574360.807471:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788574360.807481:0:15040:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788574360.807487:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574360.807489:0:15040:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788574360.807494:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574360.807508:0:15040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a791dccd40) 00000020:00000080:3.0:1788574360.807539:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788574360.807545:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574360.807622:0:15040:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7bfbe1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788574360.807631:0:15040:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788574360.807640:0:15040:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x10531a153b536a3d 00010000:00010000:3.0:1788574360.811097:0:15040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788574360.811603:0:15040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788574360.813849:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788574360.815955:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788574360.815968:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574360.815975:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574360.815977:0:15040:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788574360.815995:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574360.815999:0:15040:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788574360.816001:0:15040:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574360.816002:0:15040:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574360.816004:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574360.816007:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574360.816008:0:15040:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574360.816011:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574360.816014:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574360.816015:0:15040:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574360.816030:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574360.816032:0:15040:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788574360.816034:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574360.816036:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574360.816037:0:15040:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788574360.816039:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574360.816041:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574360.816042:0:15040:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788574360.816045:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788574360.816112:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574360.816115:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574360.816117:0:15040:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788574360.816120:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788574360.816618:0:15026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788574360.816654:0:15026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788574360.816676:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574360.816689:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574360.816698:0:15026:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7bfbe1000 from 1 10000000:01000000:2.0:1788574360.816701:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574360.816747:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574360.816756:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574360.816777:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574360.816805:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574360.816888:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.816935:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574360.817003:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747650944 00000100:00100000:0.0:1788574360.817013:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747650944 00000100:00100000:0.0:1788574360.817070:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574360.817079:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:15026:x1875455747650944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574360.817092:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574360.817107:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536a44 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.817134:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536a44 expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.817146:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a44 expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.817155:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159600, rc 0) 00000100:00100000:0.0:1788574360.817199:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747650944:12345-0@lo:101:mount.lustre.0 Request processed in 121us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574360.817206:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574360.821289:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747650944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574360.821322:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574360.821336:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574360.821914:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788574360.822235:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574360.822538:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788574360.822583:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788574360.822648:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788574360.822657:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788574360.822730:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574360.822800:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.822833:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574360.823432:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651072 00000100:00100000:0.0:1788574360.823442:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651072 00000100:00100000:0.0:1788574360.823493:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574360.823503:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574360.823787:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651072:12345-0@lo:501:mount.lustre.0 Request processed in 284us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574360.823797:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574360.824514:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574360.824573:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574360.824640:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.824669:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574360.824753:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651200 00000100:00100000:0.0:1788574360.824760:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651200 00000100:00100000:0.0:1788574360.824805:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574360.824816:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574360.824994:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651200:12345-0@lo:503:mount.lustre.0 Request processed in 181us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574360.825002:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574360.825144:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574360.825825:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574360.825906:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574360.825954:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574360.825995:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574360.826508:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651328 00000100:00100000:2.0:1788574360.826516:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651328 00000100:00100000:2.0:1788574360.826564:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574360.826573:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574360.826776:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651328:12345-0@lo:502:mount.lustre.0 Request processed in 203us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574360.826783:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574360.828896:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574360.829243:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788574360.829309:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788574360.829360:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788574360.829428:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788574360.829460:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788574360.829505:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788574360.829552:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788574360.829586:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788574360.829637:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574360.829719:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574360.833338:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574360.834459:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651456 00000100:00100000:0.0:1788574360.834480:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651456 00000100:00100000:0.0:1788574360.834565:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574360.834576:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574360.834933:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651456:12345-0@lo:502:mount.lustre.0 Request processed in 358us (5212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574360.834942:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574360.837860:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574360.838163:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788574360.838179:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788574360.841184:0:15044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574360.841206:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574360.841209:0:15044:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788574360.841218:0:15044:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7bfbe1000 00000020:00000080:0.0:1788574360.841221:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574360.841231:0:15044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574360.841234:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574360.841235:0:15044:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788574360.841237:0:15044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574360.841240:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574360.841242:0:15044:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788574360.841245:0:15044:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7bfbe1000 00000020:00000080:0.0:1788574360.841247:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574360.841401:0:15044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574360.841406:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574360.841408:0:15044:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788574360.841410:0:15044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574360.841414:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574360.841426:0:15044:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788574360.841430:0:15044:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7bfbe1000 00000020:00000080:0.0:1788574360.841432:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574360.852188:0:15044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574360.852206:0:15044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574360.852209:0:15044:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788574360.852213:0:15044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788574360.852453:0:15026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788574360.852482:0:15026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574360.852503:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.852515:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574360.852580:0:15026:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788574360.852583:0:15026:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7bfbe1000 10000000:01000000:1.0:1788574360.852586:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7bfbe1000 10000000:01000000:1.0:1788574360.852591:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574360.852596:0:15026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7bfbe1000 from 1 10000000:01000000:1.0:1788574360.852599:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574360.853757:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.853776:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.853789:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574360.853820:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574360.853894:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574360.853940:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651584 00000100:00100000:1.0:1788574360.853947:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651584 00000100:00100000:1.0:1788574360.855134:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574360.855153:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747651584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574360.855173:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574360.855194:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfb09600/0x10531a153b536a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536a52 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.855222:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfb09600/0x10531a153b536a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536a52 expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.855245:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfb09600/0x10531a153b536a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a52 expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.855255:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfb09600, rc 0) 00000100:00100000:1.0:1788574360.855319:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651584:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574360.855326:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574360.855408:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574360.855438:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574360.855457:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.855467:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574360.859546:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788574360.863249:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574360.863916:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788574360.863967:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788574360.865142:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788574360.865210:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788574360.865246:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788574360.865324:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788574360.865362:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788574360.865427:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788574360.865472:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788574360.865505:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788574360.865537:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788574360.865607:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788574360.867221:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788574360.867284:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788574360.867347:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788574360.867404:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788574360.867435:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788574360.867476:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788574360.867505:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788574360.867533:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788574360.867575:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788574360.867612:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788574360.869175:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788574360.869267:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788574360.869302:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788574360.869330:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788574360.870516:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788574360.870602:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788574360.871137:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788574360.871148:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788574360.871252:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574360.871314:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574360.871443:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574360.880717:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651712 00000100:00100000:2.0:1788574360.880733:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651712 00000100:00100000:2.0:1788574360.880812:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574360.880823:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574360.881134:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651712:12345-0@lo:501:mount.lustre.0 Request processed in 311us (9818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574360.881143:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574360.881421:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574360.881476:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574360.881524:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574360.881556:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793221600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574360.881676:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651840 00000100:00100000:0.0:1788574360.881682:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651840 00000100:00100000:0.0:1788574360.881718:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574360.881726:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574360.881879:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651840:12345-0@lo:503:mount.lustre.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574360.881886:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788574360.884817:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788574360.885588:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574360.885674:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574360.885749:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574360.885782:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793221600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574360.889164:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747651968 00000100:00100000:0.0:1788574360.889183:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747651968 00000100:00100000:0.0:1788574360.889253:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574360.889265:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574360.889581:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747651968:12345-0@lo:502:mount.lustre.0 Request processed in 316us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574360.889589:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788574360.890810:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747651968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574360.891189:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788574360.891260:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788574360.891293:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788574360.891339:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788574360.892279:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788574360.898826:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788574360.898969:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788574360.899090:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788574360.899169:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788574360.899206:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788574360.899269:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788574360.899319:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788574360.899354:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788574360.902886:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788574360.903776:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788574360.903841:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788574360.903878:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788574360.903931:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788574360.903967:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788574360.904621:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788574360.904742:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788574360.904761:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788574360.904778:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788574360.904801:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788574360.904819:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788574360.904835:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788574360.904878:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788574360.904910:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788574360.904944:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788574360.905123:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788574360.905164:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788574360.905198:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788574360.905233:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788574360.905281:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788574360.905319:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788574360.905490:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788574360.905518:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788574360.905536:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788574360.905573:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788574360.905610:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788574360.905743:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747652096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574360.905823:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.905909:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574360.905968:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652096 00000100:00100000:3.0:1788574360.906135:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652096 00000100:00100000:3.0:1788574360.906235:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788574360.906245:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747652096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574360.906490:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747652096:12345-0@lo:502:mount.lustre.0 Request processed in 246us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574360.906496:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574360.906588:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747652096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574360.906698:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788574360.906709:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788574360.907634:0:15049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788574360.907659:0:15049:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a7a7458000) 00000020:00000080:1.0:1788574360.907687:0:15049:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788574360.907770:0:15049:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7bfbe1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788574360.907774:0:15049:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7bfbe1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788574360.907775:0:15049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7bfbe1000 3 00010000:00080000:1.0:1788574360.907806:0:15049:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7bb2e8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788574360.910688:0:15049:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788574360.914096:0:15049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788574360.914144:0:15049:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574360.914160:0:15049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x10531a153b536a67 00000100:00080000:0.0:1788574360.914174:0:15049:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574360.914181:0:15049:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7bb2e8000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574360.914222:0:15049:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a788d880 x1875455747652224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574360.914332:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747652224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574360.914429:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788574360.914507:0:15049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574360.914654:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574360.914660:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574360.914669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574360.914671:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574360.914727:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747652352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574360.914759:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652224 00000100:00100000:0.0:1788574360.914761:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574360.914767:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652224 00000100:00100000:2.0:1788574360.914819:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652352 00000100:00100000:2.0:1788574360.914823:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652352 00000100:00100000:2.0:1788574360.914859:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574360.914868:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747652352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574360.914946:0:14346:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574360.914953:0:14346:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788574360.915097:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747652352:12345-0@lo:400:kworker.0 Request processed in 228us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574360.915105:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574360.915125:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574360.915129:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747652224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788574360.915151:0:14344:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:2.0:1788574360.915183:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x10531a153b536a6e 00000004:00100000:2.0:1788574360.915198:0:14344:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574360.915229:0:14344:0:(import.c:65:import_set_state_nolock()) ffff90a78c27a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574360.915267:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875455747652224:12345-0@lo:38:llog_process_th.0 Request processed in 136us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574360.915273:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788574360.915308:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7a788d880 x1875455747652224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574360.915318:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574360.915326:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788574360.915333:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788574360.915338:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788574360.915340:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788574360.915351:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747652224:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788574360.916598:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788574360.916770:0:15026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788574360.916799:0:15026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574360.916818:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574360.916830:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574360.916879:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788574360.916892:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574360.916894:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574360.916895:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574360.916896:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574360.916898:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574360.916899:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574360.916901:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574360.916902:0:15026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574360.916906:0:15026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788574360.916908:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574360.916909:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574360.916911:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574360.916912:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574360.916913:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574360.916914:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574360.916915:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574360.916916:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574360.916917:0:15026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574360.917175:0:15026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788574360.917197:0:15026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747652480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788574360.917267:0:15026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574360.917309:0:15026:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78524a0c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788574360.917778:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7933bbb80 x1875455747652352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574360.917792:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652480 00000100:00100000:0.0:1788574360.917797:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747652352:0@lo:400:kworker.0 00000100:00100000:3.0:1788574360.917801:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652480 00000100:00100000:3.0:1788574360.917849:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788574360.917861:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15026:x1875455747652480:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788574360.917893:0:14337:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788574360.917916:0:14337:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1788574360.962483:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788574360.971554:0:14337:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574360.971576:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788574360.971644:0:14360:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574360.971649:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574360.971671:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.971690:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369db expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.971700:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.971740:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5369db expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.971754:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5369db expref: 16 pid: 14337 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574360.971768:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1875455747652608:0@lo:104: 00000100:00100000:0.0:1788574360.971835:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574360.971888:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652608 00000100:00100000:1.0:1788574360.971896:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652608 00000100:00100000:0.0:1788574360.971901:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7921be000 going to sleep for 11 seconds 00000100:00100000:1.0:1788574360.971982:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574360.971992:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14360:x1875455747652608:12345-0@lo:104: 00010000:00010000:1.0:1788574360.972007:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574360.972254:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574360.972261:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14360:x1875455747652608:12345-0@lo:104: Request processed in 271us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574360.972268:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788574360.972346:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574360.972354:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972361:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159a00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574360.972426:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972437:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574360.972444:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574360.972451:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574360.972520:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972534:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574360.972569:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972575:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159a00/0x10531a153b5369db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369e2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972595:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574360.972597:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574360.972599:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574360.972611:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747652736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574360.972644:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574360.972704:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652736 00000100:00100000:3.0:1788574360.972709:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652736 00010000:00010000:3.0:1788574360.972730:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5369db expref: 17 pid: 14337 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574360.972751:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574360.972758:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:3315:x1875455747652736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574360.972769:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574360.972774:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5369db expref: 17 pid: 14337 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972784:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5369db expref: 17 pid: 14337 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972800:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972818:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788574360.972832:0:14330:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001522738s 00010000:00010000:3.0:1788574360.972837:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972844:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972851:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972858:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972863:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574360.972867:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972875:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972884:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574360.972894:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574360.972924:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:3315:x1875455747652736:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574360.972931:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574360.972975:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747652736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574360.973870:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d7400/0x10531a153b5369e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5369db expref: 16 pid: 14337 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574360.973906:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1875455747652608:0@lo:104: 00010000:00010000:0.0:1788574360.973925:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.973935:0:14360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.973941:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574360.973948:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536a75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574360.985269:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:15026:x1875455747652480:12345-0@lo:253:mount.lustre.0 Request processed in 67396us (67987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574360.985289:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788574360.985459:0:15026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15026:1875455747652480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574360.985480:0:15026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788574360.985484:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574360.985486:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574360.985488:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574360.985489:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574360.985490:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574360.985491:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574360.985493:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574360.985494:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574360.985496:0:15026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788574360.985511:0:15026:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788574360.990983:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574360.991261:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574360.991734:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574360.991909:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574360.992905:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574360.995261:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788574360.998992:0:15026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788574361.073443:0:15026:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788574361.073455:0:15026:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788574361.073492:0:15026:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788574361.073584:0:15026:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788574361.073601:0:15026:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788574361.073635:0:15026:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788574361.985473:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788574362.434104:0:14341:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788574362.434111:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a78528f000 from 7 10000000:01000000:1.0:1788574362.434115:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574362.434162:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574362.434174:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574362.434186:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574362.434213:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747652864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574362.434278:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574362.435198:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574362.437194:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652864 00000100:00100000:2.0:1788574362.437211:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652864 00000100:00100000:2.0:1788574362.437304:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574362.437315:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:14341:x1875455747652864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574362.437332:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574362.437352:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536a7c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574362.437404:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536a7c expref: 16 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574362.437417:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a7c expref: 16 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574362.437427:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985000, rc 0) 00000100:00100000:2.0:1788574362.437501:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:14341:x1875455747652864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574362.437508:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574362.437633:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747652864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574362.437651:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574362.437661:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574362.437722:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747652992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788574362.437758:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574362.438124:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574362.438157:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747652992 00000100:00100000:0.0:1788574362.438164:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747652992 00000100:00100000:0.0:1788574362.438190:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574362.438197:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:14341:x1875455747652992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788574362.438213:0:14338:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574362.438228:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574362.438231:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788574362.438623:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:14341:x1875455747652992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 425us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574362.438631:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574362.439088:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747652992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788574362.439147:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574362.439157:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574362.439166:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574363.009478:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574364.032810:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.057652:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574366.081311:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574366.340137:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574366.340144:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574366.340147:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574366.340151:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574366.342758:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747653120:0@lo:400:kworker.0 00000100:00100000:0.0:1788574366.342841:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574366.342891:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574366.342897:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747653248:0@lo:400:kworker.0 00000100:00100000:3.0:1788574366.345036:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574366.345068:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747653376:0@lo:400:kworker.0 00000100:00100000:2.0:1788574366.346148:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653120 00000100:00100000:2.0:1788574366.346163:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653120 00000100:00100000:2.0:1788574366.346226:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574366.346237:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3312:x1875455747653120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574366.346315:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3312:x1875455747653120:12345-0@lo:400:kworker.0 Request processed in 80us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574366.346323:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788574366.352828:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574366.352895:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574366.352961:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653248 00000100:00100000:0.0:1788574366.352985:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653248 00000100:00100000:0.0:1788574366.353030:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653376 00000100:00100000:0.0:1788574366.353033:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653376 00000100:00100000:0.0:1788574366.353069:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574366.353079:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747653248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574366.353165:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747653248:12345-0@lo:400:kworker.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574366.353173:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574366.353190:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574366.353197:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747653376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574366.353227:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747653376:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574366.353233:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788574366.353264:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574366.353302:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788f100 x1875455747653376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574366.353318:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747653376:0@lo:400:kworker.0 00010000:00080000:0.0:1788574366.353350:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788c380 x1875455747653248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574366.353360:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747653248:0@lo:400:kworker.0 00000100:00100000:0.0:1788574366.353395:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747653120:0@lo:400:kworker.0 00000040:00080000:2.0:1788574366.593140:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788574367.104586:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574368.064742:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574353/real 1788574353] req@ffff90a7933ba300 x1875455747648640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574368.064770:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7933ba300 x1875455747648640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574368.064780:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574353/real 1788574353] req@ffff90a7933b9f80 x1875455747648768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574368.064791:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7933b9f80 x1875455747648768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574368.064807:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574368.064826:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574368.064829:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747648640:0@lo:8:kworker.0 00000100:00080000:2.0:1788574368.064835:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574368.064839:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574368.064841:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747648768:0@lo:8:kworker.0 00000100:00080000:0.0:1788574368.065076:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574368.065081:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788574368.065084:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574368.065088:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:0.0:1788574368.065101:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788574368.065108:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a791da2800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574368.065126:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a788c380 x1875455747653632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574368.065141:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574368.065144:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788574368.065146:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574368.065149:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:0.0:1788574368.065151:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788574368.065154:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a791d0f800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574368.065163:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a788f100 x1875455747653760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574368.065201:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747653888:0@lo:400:kworker.0 00000100:00100000:0.0:1788574368.065268:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574368.065309:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574368.065314:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747654016:0@lo:400:kworker.0 00000100:00100000:0.0:1788574368.065331:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574368.065358:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653888 00000100:00100000:0.0:1788574368.065395:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653888 00000100:00100000:2.0:1788574368.065648:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574368.065657:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747653504:0@lo:400:kworker.0 00000100:00100000:2.0:1788574368.065687:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574368.065747:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654016 00000100:00100000:0.0:1788574368.065751:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654016 00000100:00100000:0.0:1788574368.065779:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574368.065786:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747653888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574368.065826:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747653888:12345-0@lo:400:kworker.0 Request processed in 40us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574368.065833:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574368.065990:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574368.065998:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747654016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574368.066029:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747654016:12345-0@lo:400:kworker.0 Request processed in 33us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574368.066035:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574368.066100:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653504 00000100:00100000:1.0:1788574368.066105:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653504 00000100:00100000:1.0:1788574368.066137:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574368.066145:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3314:x1875455747653504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574368.066183:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3314:x1875455747653504:12345-0@lo:400:kworker.0 Request processed in 40us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574368.066188:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574368.066243:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747653504:0@lo:400:kworker.0 00000100:00080000:0.0:1788574368.066296:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574368.066323:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788fb80 x1875455747654016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574368.066335:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747654016:0@lo:400:kworker.0 00010000:00080000:0.0:1788574368.066346:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788e300 x1875455747653888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574368.066354:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747653888:0@lo:400:kworker.0 00000100:00100000:0.0:1788574368.066402:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747653632:0@lo:8:kworker.0 00000100:00100000:0.0:1788574368.066443:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574368.066469:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747653760:0@lo:8:kworker.0 00000100:00100000:0.0:1788574368.066489:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574368.066757:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653632 00000100:00100000:1.0:1788574368.066762:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653632 00000100:00100000:1.0:1788574368.066785:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747653760 00000100:00100000:1.0:1788574368.066788:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747653760 00000100:00100000:1.0:1788574368.066797:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574368.066802:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747653632:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788574368.066829:0:15028:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1788574368.066900:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b536a8a 00002000:00100000:1.0:1788574368.066914:0:15028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a6811b5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788574368.066917:0:15028:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788574368.066920:0:15028:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788574368.067236:0:15028:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788574368.067262:0:15028:0:(import.c:65:import_set_state_nolock()) ffff90a6811b1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574368.067310:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875455747653632:12345-0@lo:8:kworker.0 Request processed in 506us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574368.067318:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574368.067332:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574368.067337:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747653760:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788574368.067348:0:15028:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788574368.067399:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747653760:12345-0@lo:8:kworker.0 Request processed in 61us (909us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788574368.067406:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788574368.067634:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788c380 x1875455747653632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574368.067644:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574368.067652:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788574368.067659:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574368.067664:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788574368.067666:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574368.067678:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574368.067682:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747653632:0@lo:8:kworker.0 00000100:00080000:1.0:1788574368.067708:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574368.067712:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574368.067715:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747653760:0@lo:8:kworker.0 00000004:00080000:1.0:1788574368.067766:0:14367:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788574368.067781:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1875455747654272:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788574368.067807:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574368.067823:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574368.067833:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574368.067840:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747654144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574368.068029:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574368.068068:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654272 00000100:00100000:1.0:1788574368.068073:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654272 00000100:00100000:1.0:1788574368.068110:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574368.068117:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1875455747654272:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788574368.068359:0:14366:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788574368.068707:0:14366:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 494243338079ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788574368.069402:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654144 00000100:00100000:3.0:1788574368.069411:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654144 00000100:00100000:3.0:1788574368.069470:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574368.069479:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747654144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574368.069511:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574368.069591:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747654144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574368.069598:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788574368.072199:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574368.074551:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a7844e00 x1875455747654144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574368.074585:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747654144:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788574368.079787:0:15028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788574368.079800:0:15028:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788574368.079805:0:15028:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788574368.116815:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.116830:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.117028:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.117034:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.117042:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.117074:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.117085:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.117093:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.117117:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.118203:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.118212:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118225:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.118229:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.118235:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118248:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118255:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118274:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118295:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788574368.118307:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574368.118313:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118321:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574368.118325:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118334:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118350:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118359:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536a91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118394:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574368.118398:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.118415:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574368.118419:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.119527:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.121308:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.121336:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.121344:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536a98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.121385:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.121387:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.121390:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.127842:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.127855:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.127871:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.127876:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.127882:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.127909:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.127928:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.127936:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.127961:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.128422:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.128428:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128436:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.128439:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.128443:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128451:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128458:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128465:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128491:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788574368.128504:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574368.128509:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128517:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574368.128522:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128531:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128545:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128553:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536a9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128567:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574368.128570:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128577:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574368.128580:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128597:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128606:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128613:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536aa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.128624:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.128626:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.128628:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.129074:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.136272:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.136573:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.136585:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.136603:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.136607:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.136614:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.136630:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.136640:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.136658:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.136672:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574368.137051:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574368.137059:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.137067:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.137072:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.137081:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.137103:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.137110:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536aad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.137131:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.137133:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.137135:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.137638:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.137644:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.137655:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.137658:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.137664:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.137674:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.137682:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.137690:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.137749:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.138223:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.138229:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.138242:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.138245:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.138249:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.138258:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.138266:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.138274:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141083:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574368.141099:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141113:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.141118:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141140:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141161:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141168:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e17eab8/0x10531a153b536ab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141190:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574368.141194:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141200:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.141203:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141210:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141218:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.141225:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.141227:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.141235:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.141346:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574368.141353:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5f39b52/0x10531a153b536abb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574368.143683:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.143694:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143710:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.143715:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.143721:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143746:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143756:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143763:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143787:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574368.143804:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574368.143808:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143816:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574368.143821:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143830:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143975:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.143986:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a497dec2/0x10531a153b536ac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144009:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.144011:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.144013:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.144444:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.144450:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144460:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.144463:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.144468:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144479:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144487:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144496:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144512:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574368.144521:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574368.144524:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144542:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574368.144546:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144555:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144567:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144574:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c4765e3/0x10531a153b536ac9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.144587:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.144589:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.144590:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.145986:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.146508:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.146519:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.146534:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.146537:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.146544:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.146558:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.146575:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.146583:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.146645:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.147359:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.147389:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.147399:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.147403:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.147408:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.147418:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574368.150779:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788574368.150910:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.150923:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1788574368.151944:0:15395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788574368.152528:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574368.152540:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152551:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.152556:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152567:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152589:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152596:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfad82c/0x10531a153b536ad0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152612:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574368.152616:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152621:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.152624:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152644:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152655:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.152663:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.152665:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.152667:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.153542:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574368.153555:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5b7778/0x10531a153b536ad7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574368.154229:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.154236:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.154248:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.154252:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.154258:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.154271:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.154281:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.154289:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.156979:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574368.156997:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.157011:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.157016:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.157027:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.157048:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.157150:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.157154:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.157156:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.158508:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574368.158523:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f1f849/0x10531a153b536ade lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574368.159213:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.159221:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.159235:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.159240:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.159246:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.159259:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.159269:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.159276:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.159290:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574368.159559:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.159567:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.159586:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.159591:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.159599:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.159618:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.159626:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187cb122/0x10531a153b536ae5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.159643:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.159645:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.159647:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.159704:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.160909:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.160919:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.160932:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.160936:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.160948:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.160961:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.160971:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.160978:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.161044:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.162508:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.162521:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.162533:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.162537:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.162542:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.162554:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.162562:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.162582:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.164404:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574368.164507:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.165137:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.165145:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.165161:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.165165:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.165171:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.165184:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.165195:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.165203:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.165211:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574368.165532:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574368.165647:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165658:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.165663:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165674:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165700:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165708:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f72db877/0x10531a153b536aec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165731:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.165734:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165741:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.165744:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165750:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165759:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165765:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001871328/0x10531a153b536afa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.165777:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.165779:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.165786:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.166117:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.166123:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166137:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.166140:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.166145:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166155:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166163:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166171:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166192:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574368.166510:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.166515:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.166522:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb08e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.166526:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.166533:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.166544:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.166551:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ff3960/0x10531a153b536b01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.166566:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.166567:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.166569:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.166789:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.166794:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166801:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.166804:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.166808:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166816:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166833:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166840:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.166857:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.167219:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.167225:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.167233:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.167237:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.167241:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.167250:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.167257:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.167264:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.167283:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788574368.169454:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574368.169468:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169481:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.169486:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169508:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169528:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169535:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b536b08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169555:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.169559:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169564:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.169567:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169574:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169582:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169589:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acaf691f/0x10531a153b536b0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.169609:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.169611:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.169612:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574368.170203:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.170212:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.170223:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.170228:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.170233:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.170247:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.170255:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.170263:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.172210:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574368.172865:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.172876:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.172906:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.172918:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.172926:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.172942:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.172951:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.172959:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177166:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574368.177182:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177197:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.177203:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177215:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177238:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177247:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40a6d46/0x10531a153b536b16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177272:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.177276:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177283:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.177293:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177302:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177313:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.177321:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.177323:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.177324:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.177482:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.177521:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574368.177531:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b536b1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574368.178220:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.178229:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.178245:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.178249:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.178256:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.178270:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.178284:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.178291:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.178574:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574368.178580:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.178592:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574368.178596:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.178604:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.178616:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574368.178623:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.178625:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574368.178650:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.178658:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574368.178666:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.178674:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.178687:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.178694:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000103ac516/0x10531a153b536af3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.178712:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574368.178714:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.178748:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574368.178753:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b063ce3/0x10531a153b536b24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574368.179169:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574368.179174:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.179182:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788574368.179185:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574368.179189:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.179197:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.179205:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574368.179223:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.179278:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.179284:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.179290:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.179294:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.179301:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.179312:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.179320:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.179328:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.179330:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574368.179503:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574368.179559:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.181878:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574368.181900:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f382753d/0x10531a153b536b2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.181963:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574368.182621:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574368.182631:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.182645:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788574368.182649:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574368.182654:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.182667:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.182677:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.182691:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.182716:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574368.182992:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.183000:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183009:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.183015:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183025:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183044:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183052:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a66a13d/0x10531a153b536b32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183069:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.183070:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.183072:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574368.183117:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574368.183122:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183130:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788574368.183133:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574368.183137:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183145:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183153:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183159:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183181:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574368.183419:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.183425:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183433:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.183444:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183452:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183463:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183470:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018845f14/0x10531a153b536b39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.183484:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.183486:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.183487:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574368.183662:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574368.183668:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183681:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788574368.183684:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574368.183688:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183698:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183706:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183713:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.183735:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574368.184001:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.184006:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.184014:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.184018:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.184026:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.184039:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.184052:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d05d65b/0x10531a153b536b40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.184067:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.184069:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.184070:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574368.184135:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574368.184140:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.184149:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788574368.184152:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574368.184156:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.184166:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.184184:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.184191:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574368.184209:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788574368.184399:0:15028:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788574368.185736:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1875455747654272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 117564us (117873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574368.185753:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574368.185878:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1875455747654272:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788574368.185905:0:14367:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788574368.185956:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1875455747654400:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788574368.185995:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574368.186046:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a786cdf480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574368.186095:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654400 00000100:00100000:3.0:1788574368.186102:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654400 00000100:00100000:3.0:1788574368.186147:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574368.186157:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14367:x1875455747654400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788574368.186211:0:15030:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788574368.189166:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574368.189182:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.189197:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574368.189204:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.189217:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.189252:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.189261:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba596e0c/0x10531a153b536b47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574368.189284:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.189286:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574368.189288:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574368.200343:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14367:x1875455747654400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14177us (14338us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788574368.200360:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574368.202660:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1875455747654400:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788574368.202681:0:14367:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788574369.154482:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574370.177627:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574371.208976:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788574371.525437:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788574371.525451:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788574372.224592:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574373.252726:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574373.505025:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574373.505033:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788574373.505037:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574373.505045:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1788574373.505052:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788574373.505058:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a791d0f800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574373.505081:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a7845880 x1875455747654784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574373.505122:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747655040:0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.505189:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574373.505254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574373.505259:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747654528:0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.505284:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574373.505308:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747654656:0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.505330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574373.505343:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574373.505347:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747654912:0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.505401:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574373.505424:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747654784:0@lo:8:kworker.0 00000100:00100000:1.0:1788574373.505444:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574373.505472:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655040 00000100:00100000:1.0:1788574373.505479:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655040 00000100:00100000:1.0:1788574373.505528:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654912 00000100:00100000:1.0:1788574373.505530:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654912 00000100:00100000:1.0:1788574373.505548:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574373.505557:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747655040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.505605:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747655040:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574373.505612:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574373.505628:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574373.505633:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747654912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.505655:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747654912:12345-0@lo:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574373.505661:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788574373.505694:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a7844e00 x1875455747654912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574373.505707:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747654912:0@lo:400:kworker.0 00010000:00080000:1.0:1788574373.505729:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a7846a00 x1875455747655040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574373.505737:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747655040:0@lo:400:kworker.0 00000100:00080000:0.0:1788574373.506110:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574373.507423:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654656 00000100:00100000:1.0:1788574373.507437:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654656 00000100:00100000:1.0:1788574373.507489:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654784 00000100:00100000:1.0:1788574373.507493:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654784 00000100:00100000:1.0:1788574373.507508:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574373.507516:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747654656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.507593:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747654656:12345-0@lo:400:kworker.0 Request processed in 78us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574373.507600:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574373.507615:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574373.507619:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747654784:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788574373.507636:0:15029:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788574373.508448:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574373.508917:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747654528 00000100:00100000:3.0:1788574373.508924:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747654528 00000100:00100000:3.0:1788574373.509009:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574373.509017:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3314:x1875455747654528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574373.509081:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3314:x1875455747654528:12345-0@lo:400:kworker.0 Request processed in 65us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574373.509087:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574373.509162:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747654528:0@lo:400:kworker.0 00000100:00100000:3.0:1788574373.509195:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574373.509203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747655168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574373.509238:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574373.509347:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655168 00000100:00100000:3.0:1788574373.509351:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655168 00000100:00100000:3.0:1788574373.509400:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574373.509407:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747655168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574373.509436:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574373.509470:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747655168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574373.509476:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574373.509508:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788574373.509525:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747655168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574373.516536:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747654656:0@lo:400:kworker.0 00000100:00100000:1.0:1788574373.558437:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747654784:12345-0@lo:8:kworker.0 Request processed in 50806us (52981us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788574373.558453:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788574373.558507:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574373.558512:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574373.558516:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747654784:0@lo:8:kworker.0 00010000:00010000:0.0:1788574374.273696:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574375.302737:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574376.320671:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574376.837830:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574377.350389:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574377.615906:0:15748:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574377.615920:0:15748:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788574377.616035:0:15748:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a79fbb6000 00000020:01000004:3.0:1788574377.616057:0:15748:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788574377.616071:0:15748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788574377.616085:0:15748:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a791dc8000) 00000020:00000080:3.0:1788574377.616101:0:15748:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788574377.695334:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788574377.695590:0:15748:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788574377.696251:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788574377.696521:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788574377.697561:0:15748:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788574377.698090:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 503: rc = 0 00100000:10000000:3.0:1788574377.699992:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 503: rc = 0 00100000:10000000:3.0:1788574377.702326:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 503: rc = 0 00100000:10000000:3.0:1788574377.706931:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 177: rc = 0 00100000:10000000:3.0:1788574377.709027:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 177: rc = 0 00100000:10000000:3.0:1788574377.710093:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 177: rc = 0 00100000:10000000:2.0:1788574377.714952:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 177: rc = 0 00100000:10000000:2.0:1788574377.718922:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 177: rc = 0 00100000:10000000:2.0:1788574377.719244:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 177: rc = 0 00000020:00000080:2.0:1788574377.719973:0:15748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788574377.719994:0:15748:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788574377.720006:0:15748:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x10531a153b536b55 00000020:01000004:2.0:1788574377.720015:0:15748:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788574377.720041:0:15748:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788574377.720044:0:15748:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788574377.720050:0:15748:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788574377.720073:0:15748:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788574377.720078:0:15748:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788574377.774200:0:15748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788574377.774251:0:15748:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.157@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788574377.775955:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788574377.775957:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574377.775959:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574377.775960:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574377.775961:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574377.775963:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574377.775964:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574377.775966:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574377.775967:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574377.775971:0:15748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788574377.775973:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574377.775989:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574377.775990:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574377.775991:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574377.775992:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574377.775993:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574377.775994:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574377.775995:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574377.775996:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574377.776025:0:15748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788574377.776050:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574377.776125:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.776190:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7c20c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574377.776329:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655296 00000100:00100000:2.0:1788574377.776337:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655296 00000100:00100000:2.0:1788574377.776413:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788574377.776423:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15748:x1875455747655296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574377.776466:0:14339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788574377.776469:0:14339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788574377.776473:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788574377.786508:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15748:x1875455747655296:12345-0@lo:253:mount.lustre.0 Request processed in 10074us (10370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574377.786524:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574377.788930:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574377.788959:0:15748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788574377.788963:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574377.788965:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574377.788966:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574377.788967:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574377.788968:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574377.788969:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574377.788971:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574377.788972:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574377.788973:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788574377.789000:0:15748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a79fbb6000 from lustre-OST0001 10000000:01000000:1.0:1788574377.789037:0:15748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788574377.789041:0:15748:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788574377.789050:0:15748:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a7924bcd40 local copy 00010000:00010000:1.0:1788574377.789063:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574377.790433:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574377.790507:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.790558:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbc7ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574377.791021:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655424 00000100:00100000:3.0:1788574377.791030:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655424 00000100:00100000:3.0:1788574377.791088:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788574377.791099:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15748:x1875455747655424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574377.791513:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15748:x1875455747655424:12345-0@lo:501:mount.lustre.0 Request processed in 414us (1005us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574377.791522:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574377.791776:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655424:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788574377.791798:0:15748:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788574377.792073:0:15748:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788574377.792087:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.792100:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574377.792128:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a79fbb6000 10000000:01000000:1.0:1788574377.792133:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574377.792203:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788574377.792207:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574377.792212:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788574377.792215:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788574377.792249:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.792324:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.792335:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574377.792354:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574377.792434:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.792524:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574377.797656:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655552 00000100:00100000:2.0:1788574377.797673:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655552 00000100:00100000:3.0:1788574377.797993:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788574377.798005:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:15748:x1875455747655552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574377.798022:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574377.798052:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d6000/0x10531a153b536b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536b5c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574377.798083:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d6000/0x10531a153b536b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536b5c expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574377.798096:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d6000/0x10531a153b536b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536b5c expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574377.798105:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6000, rc 0) 00000100:00100000:3.0:1788574377.798191:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655552:12345-0@lo:101:mount.lustre.0 Request processed in 188us (5756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574377.798198:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574377.798467:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574377.798486:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574377.798496:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574377.800001:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788574377.802205:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574377.802568:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788574377.803194:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788574377.803238:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788574377.803310:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788574377.803347:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788574377.803550:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788574377.803801:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788574377.803810:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788574377.804012:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574377.804085:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.804133:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbc7e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574377.804331:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655680 00000100:00100000:3.0:1788574377.804339:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655680 00000100:00100000:3.0:1788574377.804450:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788574377.804459:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574377.805163:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655680:12345-0@lo:501:mount.lustre.0 Request processed in 703us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574377.805174:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574377.805291:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574377.805349:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574377.805421:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.812664:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbc7e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788574377.812971:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655808 00000100:00100000:1.0:1788574377.812981:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655808 00000100:00100000:2.0:1788574377.813084:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574377.813096:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574377.813561:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655808:12345-0@lo:503:mount.lustre.0 Request processed in 466us (8138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574377.813569:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574377.813713:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788574377.814509:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574377.814609:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574377.814671:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.814699:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c94db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574377.815294:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747655936 00000100:00100000:2.0:1788574377.815302:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747655936 00000100:00100000:2.0:1788574377.815337:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788574377.815345:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574377.815705:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747655936:12345-0@lo:502:mount.lustre.0 Request processed in 359us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574377.815714:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574377.818463:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747655936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574377.819298:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788574377.819420:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788574377.819462:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788574377.819516:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788574377.819556:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788574377.819596:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788574377.819645:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788574377.819682:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788574377.819743:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788574377.819796:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574377.820058:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.820102:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c94db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574377.820885:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656064 00000100:00100000:2.0:1788574377.820896:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656064 00000100:00100000:2.0:1788574377.820963:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574377.820974:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747656064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574377.821252:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747656064:12345-0@lo:502:mount.lustre.0 Request processed in 277us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574377.821260:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788574377.821338:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574377.821483:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788574377.821497:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788574377.827008:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574377.827021:0:15749:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788574377.827028:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.827031:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788574377.827036:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574377.827056:0:15749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a7a745b380) 00000020:00000080:1.0:1788574377.827076:0:15749:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788574377.827082:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788574377.827789:0:15749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a79fbb6000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788574377.827800:0:15749:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788574377.827814:0:15749:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x10531a153b536b71 00010000:00010000:0.0:1788574377.841407:0:15749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788574377.841857:0:15749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788574377.843239:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788574377.850717:0:15749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788574377.850741:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574377.850748:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574377.850750:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788574377.850753:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574377.850756:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574377.850758:0:15749:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788574377.850761:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788574377.850763:0:15749:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788574377.850765:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574377.850767:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574377.850769:0:15749:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788574377.850771:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574377.850773:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574377.850775:0:15749:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788574377.850778:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788574377.851011:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574377.851016:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574377.851018:0:15749:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788574377.851021:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788574377.854805:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788574377.854850:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788574377.854873:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.854888:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574377.854898:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a79fbb6000 from 1 10000000:01000000:1.0:1788574377.854901:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574377.854958:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.854966:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.854978:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574377.855006:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574377.855092:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.855208:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574377.868029:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656192 00000100:00100000:2.0:1788574377.868051:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656192 00000100:00100000:2.0:1788574377.868121:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788574377.868131:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:15748:x1875455747656192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574377.868149:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574377.868182:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536b78 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.868215:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536b78 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.868228:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536b78 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.868238:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985c00, rc 0) 00000100:00100000:2.0:1788574377.868320:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656192:12345-0@lo:101:mount.lustre.0 Request processed in 191us (13227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574377.868345:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574377.869969:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574377.870005:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574377.870019:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574377.870629:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788574377.872343:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574377.873891:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788574377.873967:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788574377.874604:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788574377.874615:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788574377.874750:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574377.874823:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.875036:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574377.875208:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656320 00000100:00100000:3.0:1788574377.875217:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656320 00000100:00100000:3.0:1788574377.875268:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574377.875279:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574377.875580:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656320:12345-0@lo:501:mount.lustre.0 Request processed in 301us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574377.875589:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788574377.876329:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574377.876401:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574377.876450:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.876471:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574377.876558:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656448 00000100:00100000:2.0:1788574377.876564:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656448 00000100:00100000:2.0:1788574377.876595:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574377.876602:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574377.877053:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656448:12345-0@lo:503:mount.lustre.0 Request processed in 449us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574377.877061:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788574377.877294:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656448:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574377.878157:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574377.878237:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574377.878298:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.878344:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574377.878916:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656576 00000100:00100000:0.0:1788574377.878925:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656576 00000100:00100000:0.0:1788574377.878982:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788574377.878992:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574377.881081:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656576:12345-0@lo:502:mount.lustre.0 Request processed in 2080us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574377.881097:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574377.881909:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574377.882950:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788574377.883036:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788574377.883086:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788574377.883121:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788574377.883154:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788574377.884160:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788574377.884239:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788574377.884277:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788574377.884324:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574377.884713:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.884766:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574377.884771:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656704 00000100:00100000:3.0:1788574377.884786:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656704 00000100:00100000:3.0:1788574377.884851:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574377.884861:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574377.885081:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656704:12345-0@lo:502:mount.lustre.0 Request processed in 221us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574377.885089:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574377.885192:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574377.885297:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788574377.885310:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788574377.886688:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574377.886700:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.886703:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788574377.886709:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a79fbb6000 00000020:00000080:1.0:1788574377.886711:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574377.886719:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574377.886721:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.886732:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788574377.886735:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574377.886737:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.886739:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574377.886742:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a79fbb6000 00000020:00000080:1.0:1788574377.886744:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574377.886800:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574377.886804:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.886805:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788574377.886808:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574377.886810:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.886811:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574377.886814:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a79fbb6000 00000020:00000080:1.0:1788574377.886816:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574377.886850:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574377.886853:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574377.886855:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788574377.886858:0:15753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788574377.886920:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788574377.886948:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574377.886973:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.886984:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574377.887037:0:15748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788574377.887040:0:15748:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a79fbb6000 10000000:01000000:2.0:1788574377.887043:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a79fbb6000 10000000:01000000:2.0:1788574377.887047:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574377.887053:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a79fbb6000 from 1 10000000:01000000:2.0:1788574377.887056:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574377.887090:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.887114:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.887125:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574377.887147:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574377.887202:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574377.887242:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ffe480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574377.887495:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656832 00000100:00100000:0.0:1788574377.887511:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656832 00000100:00100000:0.0:1788574377.887557:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788574377.887568:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747656832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574377.887582:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574377.887596:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536b86 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574377.887633:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536b86 expref: 19 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574377.887646:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536b86 expref: 19 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574377.887655:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7bfa4d400, rc 0) 00000100:00100000:0.0:1788574377.887694:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747656832:12345-0@lo:101:mount.lustre.0 Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574377.887701:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574377.889906:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574377.889939:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574377.889952:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574377.890700:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788574377.891572:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574377.891843:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788574377.891883:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788574377.891914:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788574377.891960:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788574377.892011:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788574377.892060:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788574377.892096:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788574377.892126:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788574377.892170:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788574377.892205:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788574377.892246:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788574377.892293:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788574377.892330:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788574377.892363:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788574377.892446:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788574377.892483:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788574377.892517:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788574377.892575:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788574377.892613:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788574377.892648:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788574377.892710:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788574377.901854:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788574377.901913:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788574377.902001:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788574377.902040:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788574377.902076:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788574377.902126:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788574377.902162:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788574377.902199:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788574377.902250:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788574377.902286:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788574377.902321:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788574377.902353:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788574377.914015:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788574377.914089:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788574377.914136:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788574377.914193:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788574377.914292:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788574377.914300:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788574377.914429:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574377.916604:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574377.916678:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ffe480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574377.920668:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747656960 00000100:00100000:1.0:1788574377.920688:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747656960 00000100:00100000:1.0:1788574377.920762:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788574377.920782:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747656960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574377.921114:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747656960:12345-0@lo:501:mount.lustre.0 Request processed in 334us (6609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574377.921121:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574377.921770:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747656960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574377.926177:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747657088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574377.927018:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.927107:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7674a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574377.930186:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657088 00000100:00100000:3.0:1788574377.930216:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657088 00000100:00100000:3.0:1788574377.930326:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788574377.930339:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747657088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574377.931164:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747657088:12345-0@lo:503:mount.lustre.0 Request processed in 824us (4146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574377.931175:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574377.941063:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747657088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788574377.942183:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574377.944686:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747657216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574377.944814:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574377.944870:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78538b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574377.945818:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657216 00000100:00100000:1.0:1788574377.945831:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657216 00000100:00100000:1.0:1788574377.945884:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574377.945893:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747657216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574377.950197:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747657216:12345-0@lo:502:mount.lustre.0 Request processed in 4292us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574377.950217:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574377.950326:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747657216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574377.950669:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788574377.950746:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788574377.950783:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788574377.950857:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788574377.950895:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788574377.950938:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788574377.950973:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788574377.951021:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788574377.951069:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788574377.951101:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788574377.951142:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788574377.951185:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788574377.951221:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788574377.951253:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788574377.951297:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788574377.951345:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788574377.951404:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788574377.951448:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788574377.951483:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788574377.951515:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788574377.951564:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788574377.951599:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788574377.951632:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788574377.951716:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788574377.951765:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788574377.951799:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788574377.951850:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788574377.951887:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788574377.951920:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788574377.951966:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788574377.951999:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788574377.952029:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788574377.952060:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788574377.952105:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788574377.952140:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788574377.952189:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788574377.952225:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788574377.952260:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788574377.952312:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788574377.952390:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788574377.952457:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747657344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574377.952550:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574377.952618:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78538b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574377.952778:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657344 00000100:00100000:1.0:1788574377.952789:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657344 00000100:00100000:1.0:1788574377.952845:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574377.952856:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747657344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574377.953120:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747657344:12345-0@lo:502:mount.lustre.0 Request processed in 264us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574377.953129:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574377.960239:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747657344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574377.960677:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788574377.960695:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788574377.965206:0:15758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788574377.965225:0:15758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a79241cd40) 00000020:00000080:0.0:1788574377.965324:0:15758:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788574377.965428:0:15758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a79fbb6000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788574377.976103:0:15758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a79fbb6000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788574377.976118:0:15758:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a79fbb6000 3 00010000:00080000:3.0:1788574377.976176:0:15758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a79fbb5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.157@tcp at head 00010000:00010000:3.0:1788574377.981012:0:15758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788574377.981230:0:15758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788574377.984893:0:15758:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574377.984919:0:15758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x10531a153b536b9b 00000100:00080000:3.0:1788574377.984932:0:15758:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574377.984938:0:15758:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a79fbb5000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574377.984978:0:15758:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7926b3800 x1875455747657472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574377.985056:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747657472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574377.985131:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574377.985205:0:15758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788574377.986305:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657472 00000100:00100000:1.0:1788574377.986317:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657472 00000100:00100000:1.0:1788574377.986609:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574377.986692:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875455747657472:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788574377.986735:0:14345:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000100:00080000:0.0:1788574377.986808:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574377.986813:0:489:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788574377.986816:0:489:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574377.986821:0:489:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1788574377.986851:0:489:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788574377.986856:0:489:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a791d0f800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574377.986877:0:489:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a788c000 x1875455747657728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:1.0:1788574377.986884:0:14345:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x10531a153b536ba2 00000004:00100000:1.0:1788574377.986904:0:14345:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788574377.986945:0:14345:0:(import.c:65:import_set_state_nolock()) ffff90a6811b1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574377.988138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747657728:0@lo:8:kworker.0 00000100:00100000:2.0:1788574377.988206:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574377.988290:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657728 00000100:00100000:3.0:1788574377.988297:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657728 00000100:00100000:3.0:1788574377.988332:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574377.988339:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747657728:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788574377.988412:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747657728:12345-0@lo:8:kworker.0 Request processed in 71us (206us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788574377.988419:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574377.992431:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747657600:0@lo:400:kworker.0 00000100:00100000:1.0:1788574377.992942:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875455747657472:12345-0@lo:38:llog_process_th.0 Request processed in 6245us (7805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574377.992955:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574377.992969:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747657984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574377.993012:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574377.993045:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657984 00000100:00100000:1.0:1788574377.993056:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657984 00000100:00100000:0.0:1788574377.993146:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.993173:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574377.993180:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747657856:0@lo:400:kworker.0 00000100:00100000:0.0:1788574377.993208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574377.993250:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657856 00000100:00100000:0.0:1788574377.993255:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657856 00000100:00100000:0.0:1788574377.993302:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574377.993311:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747657856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574377.993361:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747657856:12345-0@lo:400:kworker.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574377.993395:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788574377.993436:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788f480 x1875455747657856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574377.993449:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747657856:0@lo:400:kworker.0 00000100:00100000:1.0:1788574377.994307:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574377.994319:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747657984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574377.994407:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747657984:12345-0@lo:400:kworker.0 Request processed in 92us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574377.994415:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574377.994438:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747657600 00000100:00100000:1.0:1788574377.994443:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747657600 00010000:00080000:2.0:1788574377.995102:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7926b3800 x1875455747657472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574377.995114:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574377.995122:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788574377.995130:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788574377.995135:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788574377.995138:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a79fbb5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788574377.995144:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747657472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574377.995172:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574377.995176:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574377.995179:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788574377.995183:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747657728:0@lo:8:kworker.0 00000040:00080000:0.0:1788574377.995534:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:3.0:1788574377.995897:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574377.995904:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1788574377.995940:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788574377.995986:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788574377.996013:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574377.996027:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788574377.996082:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788574377.996085:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574377.996087:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574377.996088:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574377.996089:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574377.996091:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574377.996092:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574377.996094:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574377.996096:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574377.996102:0:15748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788574377.996105:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574377.996106:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574377.996107:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574377.996109:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574377.996110:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574377.996111:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574377.996112:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574377.996113:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574377.996114:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574377.996140:0:15748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788574377.996162:0:15748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747658112:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788574377.996262:0:15748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574377.996301:0:15748:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78538b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574377.998146:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574377.998239:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747657600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574377.998346:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747657600:12345-0@lo:400:kworker.0 Request processed in 187us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574377.998354:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574377.998397:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658112 00000100:00100000:1.0:1788574377.998406:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658112 00000100:00100000:1.0:1788574377.998440:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788574377.998443:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747657600:0@lo:400:kworker.0 00000100:00100000:1.0:1788574377.998451:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:15748:x1875455747658112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574377.998476:0:14339:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788574377.998493:0:14339:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788574377.999397:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a788e680 x1875455747657984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574377.999412:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747657984:0@lo:400:kworker.0 20000000:01000000:1.0:1788574378.061350:0:14339:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788574378.065746:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788574378.065855:0:14360:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574378.065861:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574378.065892:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.065934:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a7c expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.065943:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.065986:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b536a7c expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.066001:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b536a7c expref: 19 pid: 14339 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574378.066015:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1875455747658240:0@lo:104: 00000100:00100000:0.0:1788574378.066090:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574378.066159:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574378.066268:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658240 00000100:00100000:2.0:1788574378.066276:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658240 00000100:00100000:2.0:1788574378.066336:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574378.066346:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14360:x1875455747658240:12345-0@lo:104: 00010000:00010000:2.0:1788574378.066360:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574378.066445:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574378.066452:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:14360:x1875455747658240:12345-0@lo:104: Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574378.066459:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788574378.066481:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574378.066498:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574378.066506:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574378.066510:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574378.066519:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574378.066527:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574378.066532:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574378.066559:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574378.066566:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574378.066585:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574378.066592:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09400/0x10531a153b536a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536a83 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574378.066858:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747658368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574378.066889:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574378.066929:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658368 00000100:00100000:0.0:1788574378.066933:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658368 00010000:00010000:0.0:1788574378.066953:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b536a7c expref: 20 pid: 14339 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574378.066975:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574378.066981:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+20:3315:x1875455747658368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574378.066990:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574378.066995:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b536a7c expref: 20 pid: 14339 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067015:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b536a7c expref: 20 pid: 14339 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067031:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067040:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788574378.067053:0:14330:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001522738s 00010000:00010000:0.0:1788574378.067057:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067064:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067071:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067078:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067083:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4dc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574378.067087:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067094:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067103:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067119:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574378.067146:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+20:3315:x1875455747658368:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574378.067152:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574378.067187:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747658368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574378.067213:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985000/0x10531a153b536a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b536a7c expref: 19 pid: 14339 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574378.067224:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1875455747658240:0@lo:104: 00010000:00010000:0.0:1788574378.067237:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067245:0:14360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067262:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574378.067267:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4dc00/0x10531a153b536ba9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574378.067440:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574378.067443:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574378.067445:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574378.094167:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:15748:x1875455747658112:12345-0@lo:253:mount.lustre.0 Request processed in 95710us (97896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574378.094185:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574378.094566:0:15748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:15748:1875455747658112:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788574378.094585:0:15748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788574378.094589:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574378.094590:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574378.094609:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574378.094679:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574378.094680:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574378.094682:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574378.094683:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574378.094685:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574378.094686:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788574378.094702:0:15748:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788574378.099901:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574378.100101:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574378.100348:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574378.100764:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574378.100914:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574378.101123:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788574378.102225:0:15748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788574378.186316:0:15748:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788574378.186340:0:15748:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788574378.186592:0:15748:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788574378.186665:0:15748:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788574378.186684:0:15748:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788574378.186715:0:15748:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788574378.371979:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574378.626224:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574378.626248:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747658496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574378.626325:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574378.626496:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658496 00000100:00100000:2.0:1788574378.626517:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658496 00000100:00100000:2.0:1788574378.626570:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574378.626581:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747658496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574378.626621:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574378.626670:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747658496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574378.626677:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574378.626738:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747658496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788574379.399175:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788574379.520926:0:14341:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574379.520937:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a78528f000 from 8 10000000:01000000:0.0:1788574379.520943:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574379.521007:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.521021:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.521035:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574379.521065:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747658624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574379.521140:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574379.521199:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797d74180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574379.521276:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658624 00000100:00100000:3.0:1788574379.521284:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658624 00000100:00100000:3.0:1788574379.521346:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574379.521355:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747658624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574379.521399:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574379.521413:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d7200/0x10531a153b536bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536bb0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574379.521436:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d7200/0x10531a153b536bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536bb0 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574379.521446:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d7200/0x10531a153b536bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536bb0 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574379.521455:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7200, rc 0) 00000100:00100000:3.0:1788574379.521495:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747658624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.521502:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788574379.522013:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747658624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574379.522031:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.522041:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574379.522105:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747658752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788574379.522154:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574379.522189:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797d74180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574379.524461:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658752 00000100:00100000:1.0:1788574379.524482:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658752 00000100:00100000:1.0:1788574379.524555:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574379.524579:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747658752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574379.524605:0:14339:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574379.524628:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574379.524631:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788574379.524779:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747658752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 215us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574379.524786:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574379.524846:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747658752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788574379.524919:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574379.524930:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574379.524941:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574380.423922:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574381.440755:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574382.472823:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574383.232888:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574383.232896:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788574383.232910:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574383.232923:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a791d0f800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574383.232952:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a7846a00 x1875455747659136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574383.233009:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747659392:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.233082:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.233152:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788574383.233159:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747658880:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.233190:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.233214:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747659520:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.233240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.233266:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747659008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.233294:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.233311:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574383.233315:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747659264:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.233334:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.233359:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747659136:0@lo:8:kworker.0 00000100:00100000:1.0:1788574383.233408:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.233442:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659392 00000100:00100000:1.0:1788574383.233451:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659392 00000100:00100000:1.0:1788574383.233502:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659520 00000100:00100000:1.0:1788574383.233506:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659520 00000100:00100000:1.0:1788574383.233521:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659264 00000100:00100000:1.0:1788574383.233679:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659264 00000100:00100000:1.0:1788574383.233706:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574383.233714:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747659392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.233782:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747659392:12345-0@lo:400:kworker.0 Request processed in 69us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574383.233790:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574383.233908:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574383.233918:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747659520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574383.233953:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747659520:12345-0@lo:400:kworker.0 Request processed in 37us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.233959:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574383.233971:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574383.233977:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747659264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574383.234009:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747659264:12345-0@lo:400:kworker.0 Request processed in 32us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.234014:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574383.234037:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747658880 00000100:00100000:0.0:1788574383.234041:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747658880 00000100:00100000:0.0:1788574383.234070:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788574383.234076:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747658880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574383.234107:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747658880:12345-0@lo:400:kworker.0 Request processed in 32us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.234113:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788574383.234160:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659008 00000100:00100000:0.0:1788574383.234164:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659008 00000100:00100000:0.0:1788574383.234188:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659136 00000100:00100000:0.0:1788574383.234191:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659136 00000100:00100000:0.0:1788574383.234202:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574383.234208:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747659008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574383.234239:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747659008:12345-0@lo:400:kworker.0 Request processed in 32us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.234253:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574383.234265:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574383.234269:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747659136:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788574383.234297:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1788574383.234330:0:15029:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b536bbe 00002000:00100000:0.0:1788574383.234348:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a682204800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788574383.234352:0:15029:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788574383.234355:0:15029:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1788574383.234677:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7845880 x1875455747659264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574383.234690:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747659264:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.234703:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747659008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574383.234743:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747658880:0@lo:400:kworker.0 00010000:00080000:1.0:1788574383.234754:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7845f80 x1875455747659520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574383.234763:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747659520:0@lo:400:kworker.0 00010000:00080000:1.0:1788574383.234774:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7846680 x1875455747659392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574383.234782:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747659392:0@lo:400:kworker.0 00002000:00080000:0.0:1788574383.235289:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788574383.235317:0:15029:0:(import.c:65:import_set_state_nolock()) ffff90a682205000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788574383.236108:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574383.236116:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574383.236405:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875455747659136:12345-0@lo:8:kworker.0 Request processed in 2129us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.236417:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788574383.242407:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7846a00 x1875455747659136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574383.242434:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788574383.242443:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574383.242449:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788574383.242453:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574383.242491:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574383.242497:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747659136:0@lo:8:kworker.0 00000004:00080000:0.0:1788574383.242673:0:14369:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788574383.242696:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1875455747659776:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788574383.242765:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574383.242797:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574383.242835:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659776 00000100:00100000:0.0:1788574383.242843:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659776 00000100:00100000:0.0:1788574383.242921:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574383.242933:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14369:x1875455747659776:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788574383.245508:0:15028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788574383.245519:0:15028:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788574383.245524:0:15028:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:2.0:1788574383.246995:0:14368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788574383.247393:0:14368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 509422024120ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788574383.254274:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574383.254315:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747659648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574383.254420:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574383.254472:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659648 00000100:00100000:1.0:1788574383.254480:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659648 00000100:00100000:1.0:1788574383.254539:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574383.254549:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747659648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574383.254586:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574383.254643:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747659648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574383.254652:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788574383.254698:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a788f100 x1875455747659648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574383.254717:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747659648:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788574383.254756:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788574383.275228:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574383.275243:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.275263:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788574383.275268:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574383.275276:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.275296:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.275308:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.275323:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.275349:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574383.275650:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.275659:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.275669:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.275673:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.275683:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.275708:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.275718:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.275719:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.275721:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.281292:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d233bd4/0x10531a153b536bc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574383.283145:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574383.283157:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283191:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788574383.283195:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574383.283201:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283216:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283225:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283233:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283267:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574383.283283:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574383.283288:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283297:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574383.283301:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283311:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283329:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283336:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52aa0f3/0x10531a153b536bcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.283355:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.283357:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.283358:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574383.291801:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574383.291816:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.291835:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788574383.291850:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574383.291857:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.291873:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.291899:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.291907:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.292324:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574383.292340:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574383.292347:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.292357:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574383.292362:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.292398:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.292418:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.292439:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536bd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.292465:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.292468:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.292471:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574383.293044:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574383.293051:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.293061:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788574383.293065:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574383.293069:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.293080:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.293089:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.293096:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.293119:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574383.298014:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574383.298035:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.298053:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1788574383.298058:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574383.298065:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.298083:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.298094:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.298103:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.298122:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788574383.298135:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574383.298142:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.298151:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574383.298156:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.298282:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.298289:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.298298:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.298301:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.298310:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.298327:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.298335:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a842df/0x10531a153b536be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.298360:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.298362:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.298364:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.304329:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.304392:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.304401:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000075f0cb0/0x10531a153b536bda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574383.304425:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.304427:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574383.304430:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.311713:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.311733:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.311751:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.311756:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.311762:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.311780:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.311790:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.311798:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.311814:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574383.312304:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.312310:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.312318:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.312322:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.312326:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.312335:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.312348:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.312355:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.312391:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574383.312925:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574383.312934:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.312955:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574383.312960:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.312970:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.312989:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.312996:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.313015:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574383.313018:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.313025:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574383.313028:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.313035:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.313044:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.313055:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536bef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.313067:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.313069:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.313071:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.313085:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.313936:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.313945:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.313956:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.313959:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.313965:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.313976:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.313984:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.313991:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.314018:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.314031:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.314036:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.314044:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.314047:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.314056:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.314069:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.314077:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.314093:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.314096:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.314098:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.320876:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.320891:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.320910:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.320922:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.320928:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.320946:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.320956:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.320964:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.320993:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574383.321411:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574383.321421:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.321432:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574383.321439:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.321450:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.321468:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.321477:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536bfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.321504:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.321507:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.321517:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.324836:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.324850:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324866:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.324870:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.324875:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324889:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324900:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324914:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324933:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.324947:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.324952:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324960:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.324964:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324974:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.324994:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.325003:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.325030:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.325032:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.325035:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.327680:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.327702:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327718:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.327723:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.327730:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327745:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327754:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327762:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327778:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.327792:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.327798:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327805:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.327810:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327819:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327841:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327850:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.327870:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.327872:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.327874:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.328449:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.328456:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.328464:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.328467:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.328472:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.328481:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.328490:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.328498:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.333889:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574383.333961:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574383.333972:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.333989:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574383.333995:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.334008:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.334032:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.334040:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.334064:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.334066:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.334067:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788574383.336422:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1788574383.339925:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788574383.340012:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.340023:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340042:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.340047:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.340053:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340069:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340080:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340088:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340104:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.340117:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.340123:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340149:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ca00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.340155:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340165:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340182:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340189:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003eaa26c/0x10531a153b536c19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340210:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.340211:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.340213:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.340838:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.340845:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340855:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.340858:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.340862:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340873:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340888:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340896:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340910:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.340921:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.340926:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340934:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.340937:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340945:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340957:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340964:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d6b700/0x10531a153b536c20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.340979:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.340986:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.340988:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.341399:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.341406:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341414:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.341418:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.341422:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341431:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341440:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341446:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341462:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.341471:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.341475:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341482:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.341486:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341505:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341516:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341524:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cbde83e/0x10531a153b536c27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341538:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.341540:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.341541:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.341968:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.341974:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.341983:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.341986:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.341989:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342000:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342008:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342022:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342037:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.342047:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.342053:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342060:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4de00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.342064:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342072:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342084:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342091:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d209936/0x10531a153b536c2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342106:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.342108:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.342110:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.342561:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.342575:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342584:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.342588:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.342592:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342602:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342611:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.342618:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.344759:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574383.344794:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574383.344935:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.344951:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574383.344957:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.344969:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.345002:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.345011:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f842ab66/0x10531a153b536c35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.345032:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.345034:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.345036:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.346097:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.346106:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.346120:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.346124:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.346130:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.346144:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.346153:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.346160:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.346190:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574383.346312:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574383.346322:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.346333:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4cc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574383.346339:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.346363:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.346399:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.346407:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c004d4a/0x10531a153b536c3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574383.346437:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.346439:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.346441:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.347067:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.347074:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347086:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.347089:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.347094:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347104:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347112:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347119:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347183:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574383.347731:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.347739:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347748:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.347757:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.347762:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347773:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347781:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.347787:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.347993:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574383.348000:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348008:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.348013:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348021:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348035:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348042:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e21436a/0x10531a153b536c43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348059:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.348062:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348068:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.348071:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348077:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348094:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.348101:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.348102:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.348104:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.348140:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574383.348145:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086a813a0/0x10531a153b536c4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.348164:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.349025:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.349033:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349044:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.349047:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.349052:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349065:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349081:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349088:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349148:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574383.349752:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.349760:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349770:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.349773:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.349777:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349787:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349796:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.349940:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350017:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574383.350026:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350035:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4da00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.350041:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350052:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350067:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350075:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722f417a/0x10531a153b536c51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350096:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.350100:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350118:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4dc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.350122:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350130:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350141:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.350150:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.350153:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.350155:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.350231:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574383.350236:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c9b44c/0x10531a153b536c58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574383.350948:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.350956:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.350967:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.350972:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.350978:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.350990:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.350999:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.351006:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.351114:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.351121:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.351129:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.351132:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.351142:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.351155:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.351175:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.351176:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.351178:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.351253:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574383.351259:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000424232fa/0x10531a153b536c5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574383.351949:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.351956:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.351965:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.351969:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.351974:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.351986:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.351995:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.352002:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.354305:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.354323:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.354340:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.354346:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.354358:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.354407:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.354722:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574383.354731:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d075e93/0x10531a153b536c66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574383.355551:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.355560:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.355586:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.355590:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.355596:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.355608:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.355618:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.355626:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.357499:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.357516:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.357599:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4c000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.357604:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.357653:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.357680:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.357695:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.357697:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.357699:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.357868:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.357872:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.357876:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574383.357878:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574383.357898:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574383.357907:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c2ec56c/0x10531a153b536c6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574383.359018:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.359029:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359042:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.359047:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.359054:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359081:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359090:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359097:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359119:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574383.359645:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.359653:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.359663:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4ce00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.359668:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.359680:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.359696:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.359704:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000031c4a12/0x10531a153b536c74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.359736:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.359738:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.359740:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574383.359823:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.359829:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359839:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.359842:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.359847:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359857:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359866:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359885:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.359907:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574383.360399:0:15028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574383.360405:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.360415:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1788574383.360419:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574383.360424:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.360434:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.360443:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.360449:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574383.360464:0:15028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788574383.360732:0:15028:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788574383.360851:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14369:x1875455747659776:12345-0@lo:5:osp-pre-1-0.0 Request processed in 117914us (118079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.360869:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574383.360935:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1875455747659776:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788574383.360953:0:14369:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788574383.361000:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1875455747659904:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788574383.361037:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574383.361078:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574383.361102:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747659904 00000100:00100000:0.0:1788574383.361108:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747659904 00000100:00100000:0.0:1788574383.361156:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574383.361166:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14369:x1875455747659904:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788574383.361205:0:15029:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788574383.361639:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574383.361648:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361657:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ac00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574383.361661:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361672:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361689:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361697:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536c7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361720:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574383.361724:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361731:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574383.361736:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.361743:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361753:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361763:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361771:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536c82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574383.361785:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.361786:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574383.361788:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574383.367282:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14369:x1875455747659904:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6110us (6236us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788574383.367299:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574383.367584:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1875455747659904:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788574383.367599:0:14369:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788574383.489685:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574383.745876:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574383.745918:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747660032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574383.746019:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574383.746115:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660032 00000100:00100000:3.0:1788574383.746128:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660032 00000100:00100000:3.0:1788574383.746646:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574383.746660:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747660032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574383.746839:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574383.746905:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747660032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574383.746931:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574383.747921:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747660032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788574384.515353:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574385.544976:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574386.056172:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788574386.299262:0:16108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788574386.560900:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574387.587891:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574388.352648:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747660160:0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.352746:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.352819:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747660416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574388.352870:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.352893:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747660928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574388.352916:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.352951:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574388.352958:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747660544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574388.352983:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.353016:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660416 00000100:00100000:2.0:1788574388.353024:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660416 00000100:00100000:2.0:1788574388.353085:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574388.353094:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747660416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574388.353143:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747660416:12345-0@lo:400:kworker.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.353150:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574388.353171:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660928 00000100:00100000:2.0:1788574388.353174:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660928 00000100:00100000:2.0:1788574388.353194:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574388.353199:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747660928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574388.353222:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574388.353250:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747660928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574388.353492:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747660672:0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.353518:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.353540:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788574388.353558:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747660288:0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.353581:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.353606:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747660800:0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.353628:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.353667:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660160 00000100:00100000:1.0:1788574388.353673:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660160 00000100:00100000:1.0:1788574388.353707:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574388.353714:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747660160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.353750:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747660160:12345-0@lo:400:kworker.0 Request processed in 36us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574388.353769:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788574388.354042:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660288 00000100:00100000:0.0:1788574388.354048:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660288 00000100:00100000:0.0:1788574388.354097:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574388.354105:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747660288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574388.354142:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747660288:12345-0@lo:400:kworker.0 Request processed in 39us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574388.354149:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788574388.354497:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574388.354502:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574388.354513:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660544 00000100:00100000:1.0:1788574388.354518:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660544 00000100:00100000:1.0:1788574388.354552:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660672 00000100:00100000:1.0:1788574388.354556:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660672 00000100:00100000:1.0:1788574388.354573:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747660800 00000100:00100000:1.0:1788574388.354575:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747660800 00000100:00100000:1.0:1788574388.354588:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574388.354594:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747660544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.354629:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747660544:12345-0@lo:400:kworker.0 Request processed in 35us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574388.354636:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574388.354647:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574388.354653:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747660672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.354681:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747660672:12345-0@lo:400:kworker.0 Request processed in 29us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574388.354687:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574388.354697:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574388.354702:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747660800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.354729:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747660800:12345-0@lo:400:kworker.0 Request processed in 27us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574388.354735:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788574388.355604:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574388.355653:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747660288:0@lo:400:kworker.0 00010000:00080000:1.0:1788574388.355683:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05880 x1875455747660800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574388.355695:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747660800:0@lo:400:kworker.0 00000100:00100000:1.0:1788574388.355707:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747660160:0@lo:400:kworker.0 00010000:00080000:1.0:1788574388.355718:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d05c00 x1875455747660672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574388.355727:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747660672:0@lo:400:kworker.0 00000100:00100000:2.0:1788574388.357664:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788574388.357774:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a791d06680 x1875455747660544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574388.357793:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747660544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574388.357814:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747660416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574388.357836:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747660928:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788574388.516963:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1788574388.608823:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574388.864562:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574388.864588:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747661056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574388.864682:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.864889:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661056 00000100:00100000:2.0:1788574388.864899:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661056 00000100:00100000:2.0:1788574388.864955:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574388.864974:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747661056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574388.865019:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574388.865089:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747661056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.865097:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574388.865146:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747661056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574389.325398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.325509:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739264 00000100:00100000:2.0:1788574389.325536:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739264 00000100:00100000:2.0:1788574389.325889:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:2.0:1788574389.325900:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1875455727739264:12345-192.168.201.57@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788574389.325951:0:14339:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 125108d1-8047-4740-b3d2-4049e113b9ae@192.168.201.57@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1788574389.325991:0:14339:0:(genops.c:1385:class_connect()) connect: client 125108d1-8047-4740-b3d2-4049e113b9ae, cookie 0x10531a153b536c89 00000100:00080000:2.0:1788574389.326181:0:14339:0:(import.c:65:import_set_state_nolock()) ffff90a68134a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574389.326278:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+5:2352:x1875455727739264:12345-192.168.201.57@tcp:250:mount.lustre.0 Request processed in 378us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.326286:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:0.0:1788574389.349285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.349633:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739392 00000100:00100000:1.0:1788574389.349647:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739392 00000100:00100000:1.0:1788574389.349711:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:1.0:1788574389.349723:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+5:13737:x1875455727739392:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574389.349743:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574389.349765:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21e00/0x10531a153b536c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b5d expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.349798:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21e00/0x10531a153b536c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b5d expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.349811:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21e00/0x10531a153b536c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b5d expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.349821:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21e00, rc 0) 00000100:00100000:1.0:1788574389.349890:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+6:13737:x1875455727739392:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 169us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.349913:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:0.0:1788574389.358973:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.359044:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739520 00000100:00100000:2.0:1788574389.359128:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739520 00000100:00100000:2.0:1788574389.359184:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:2.0:1788574389.359194:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+6:13737:x1875455727739520:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574389.361755:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+6:13737:x1875455727739520:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 2547us (2777us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574389.361782:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:2.0:1788574389.368987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.369284:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739648 00000100:00100000:1.0:1788574389.369296:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739648 00000100:00100000:2.0:1788574389.369455:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:2.0:1788574389.369484:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+6:13737:x1875455727739648:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574389.369504:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574389.369535:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e984200/0x10531a153b536c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b64 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.369569:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984200/0x10531a153b536c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b64 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.369581:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e984200/0x10531a153b536c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b64 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.369590:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984200, rc 0) 00000100:00100000:2.0:1788574389.369657:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+7:13737:x1875455727739648:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 176us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.369664:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:0.0:1788574389.379004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.379101:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739776 00000100:00100000:2.0:1788574389.379111:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739776 00000100:00100000:2.0:1788574389.379170:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:2.0:1788574389.379182:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+7:13737:x1875455727739776:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574389.379983:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+8:13737:x1875455727739776:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 797us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.379995:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:0.0:1788574389.384922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.385075:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727739904 00000100:00100000:2.0:1788574389.385086:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727739904 00000100:00100000:2.0:1788574389.385594:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:2.0:1788574389.385609:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+8:13737:x1875455727739904:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788574389.386038:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+8:13737:x1875455727739904:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 430us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.386047:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:2.0:1788574389.438173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574389.441478:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740032 00000100:00100000:0.0:1788574389.441506:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740032 00000100:00100000:0.0:1788574389.441595:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:0.0:1788574389.441607:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+8:13755:x1875455727740032:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574389.442026:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+8:13755:x1875455727740032:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 420us (3865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.442034:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:0.0:1788574389.478063:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.478174:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740160 00000100:00100000:2.0:1788574389.478185:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740160 00000100:00100000:2.0:1788574389.478248:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:2.0:1788574389.478259:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+8:13755:x1875455727740160:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574389.479077:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+8:13755:x1875455727740160:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 815us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.479087:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:0.0:1788574389.485272:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.485894:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740288 00000100:00100000:1.0:1788574389.485908:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740288 00000100:00100000:1.0:1788574389.485986:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:1.0:1788574389.485999:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+8:13737:x1875455727740288:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574389.486021:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574389.486045:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20a00/0x10531a153b536c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b8e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.486086:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20a00/0x10531a153b536c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b8e expref: 9 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.486098:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20a00/0x10531a153b536c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b8e expref: 9 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.486109:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20a00, rc 0) 00000100:00100000:1.0:1788574389.486178:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+9:13737:x1875455727740288:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 182us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.486187:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:1.0:1788574389.494819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.495042:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740416 00000100:00100000:2.0:1788574389.495055:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740416 00000100:00100000:2.0:1788574389.495147:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:2.0:1788574389.495158:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+9:13737:x1875455727740416:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788574389.495189:0:14338:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788574389.495214:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574389.495218:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788574389.495221:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788574389.495243:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788574389.501243:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+9:13737:x1875455727740416:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 6076us (6424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.501257:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:0.0:1788574389.510025:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.510182:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740544 00000100:00100000:1.0:1788574389.510194:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740544 00000100:00100000:1.0:1788574389.510257:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:1.0:1788574389.510268:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+9:13737:x1875455727740544:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574389.510288:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574389.510319:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3b95 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.510348:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.510360:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.510416:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21200, rc 0) 00000100:00100000:1.0:1788574389.510478:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+10:13737:x1875455727740544:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 211us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.510485:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:1.0:1788574389.523595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.524702:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740672 00000100:00100000:2.0:1788574389.524720:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740672 00000100:00100000:2.0:1788574389.524802:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:2.0:1788574389.524813:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+10:13737:x1875455727740672:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574389.525180:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+10:13737:x1875455727740672:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 366us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.525201:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:3.0:1788574389.527555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.527976:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740800 00000100:00100000:2.0:1788574389.527988:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740800 00000100:00100000:2.0:1788574389.528063:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:2.0:1788574389.528072:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+10:13737:x1875455727740800:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788574389.528765:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+10:13737:x1875455727740800:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 690us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.528775:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:0.0:1788574389.531884:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.532313:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727740928 00000100:00100000:1.0:1788574389.532324:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727740928 00000100:00100000:1.0:1788574389.532607:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:1.0:1788574389.532620:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+10:13759:x1875455727740928:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574389.532966:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+10:13759:x1875455727740928:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 348us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.532976:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:1.0:1788574389.555818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574389.556127:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741056 00000100:00100000:0.0:1788574389.556138:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741056 00000100:00100000:0.0:1788574389.556208:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:0.0:1788574389.556222:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bd2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+10:13759:x1875455727741056:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574389.556604:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bd2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+10:13759:x1875455727741056:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 384us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.556621:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:3.0:1788574389.574352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.574476:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741184 00000100:00100000:1.0:1788574389.574494:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741184 00000100:00100000:1.0:1788574389.574551:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788574389.574563:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875455727741184:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788574389.574602:0:14346:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5767af78-1871-405c-8c59-f96bc15eec86@192.168.201.57@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1788574389.574684:0:14346:0:(genops.c:1385:class_connect()) connect: client 5767af78-1871-405c-8c59-f96bc15eec86, cookie 0x10531a153b536cac 00000004:00100000:1.0:1788574389.574722:0:14346:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788574389.574729:0:14346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788574389.633082:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574389.668438:0:14346:0:(import.c:65:import_set_state_nolock()) ffff90a682201000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574389.669361:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+6:2352:x1875455727741184:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 94793us (95015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.669398:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788574389.680910:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.681090:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741312 00000100:00100000:1.0:1788574389.681102:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741312 00000100:00100000:1.0:1788574389.681192:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788574389.681204:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:0:x1875455727741312:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574389.681258:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788574389.681348:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:0:x1875455727741312:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 146us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.681355:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00080000:2.0:1788574389.681656:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574389.681892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574389.682753:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741440 00000100:00100000:1.0:1788574389.682775:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741440 00000100:00100000:1.0:1788574389.682877:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788574389.682887:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:13737:x1875455727741440:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574389.682913:0:14345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788574389.682982:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:13737:x1875455727741440:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 96us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.682989:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574389.689340:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574389.689444:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741568 00000100:00100000:0.0:1788574389.689453:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741568 00000100:00100000:0.0:1788574389.689510:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788574389.689527:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:13737:x1875455727741568:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788574389.689605:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:13737:x1875455727741568:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.689613:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574389.693503:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.693750:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741952 00000100:00100000:2.0:1788574389.693772:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741952 00000100:00100000:2.0:1788574389.693841:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788574389.693854:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:13737:x1875455727741952:12345-192.168.201.57@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788574389.694735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574389.694783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574389.694809:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741696 00000100:00100000:3.0:1788574389.694815:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741696 00000100:00100000:3.0:1788574389.694840:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727741824 00000100:00100000:3.0:1788574389.694842:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727741824 00000100:00100000:3.0:1788574389.694853:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574389.694861:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727741696:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574389.694887:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5767af78-1871-405c-8c59-f96bc15eec86@192.168.201.57@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:3.0:1788574389.694915:0:15029:0:(genops.c:1385:class_connect()) connect: client 5767af78-1871-405c-8c59-f96bc15eec86, cookie 0x10531a153b536cb3 00002000:00100000:3.0:1788574389.694927:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5767af78-1871-405c-8c59-f96bc15eec86/ffff90a683b2f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574389.694938:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574389.695301:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788574389.695332:0:15029:0:(import.c:65:import_set_state_nolock()) ffff90a683b2d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574389.695421:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:2352:x1875455727741696:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 559us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574389.695430:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574389.695450:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788574389.695465:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727741824:12345-192.168.201.57@tcp:8:mount.lustre.0 00000004:00080000:0.0:1788574389.696599:0:14347:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2667us 00010000:00080000:3.0:1788574389.696931:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5767af78-1871-405c-8c59-f96bc15eec86@192.168.201.57@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:3.0:1788574389.696960:0:15029:0:(genops.c:1385:class_connect()) connect: client 5767af78-1871-405c-8c59-f96bc15eec86, cookie 0x10531a153b536cba 00002000:00100000:3.0:1788574389.696971:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5767af78-1871-405c-8c59-f96bc15eec86/ffff90a683b29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574389.696980:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574389.700143:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788574389.700199:0:15029:0:(import.c:65:import_set_state_nolock()) ffff90a683b2e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574389.700267:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:2352:x1875455727741824:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 4799us (5481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574389.700280:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000004:00200000:0.0:1788574389.736437:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788574389.736574:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:13737:x1875455727741952:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 42717us (43090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.736590:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574389.991893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574389.994883:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742080 00000100:00100000:2.0:1788574389.994911:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742080 00000100:00100000:2.0:1788574389.995071:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574389.995083:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+6:13780:x1875455727742080:12345-192.168.201.57@tcp:101:mkdir.0 00010000:00010000:2.0:1788574389.995106:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574389.995139:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536cc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3bbf expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.995225:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536cc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.995240:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.995287:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574389.995348:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788574389.995353:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574389.995418:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.995447:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536cc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bbf expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.995467:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bbf expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574389.995777:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:2.0:1788574389.995782:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574389.995786:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984a00, rc 0) 00000100:00100000:2.0:1788574389.995887:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+7:13780:x1875455727742080:12345-192.168.201.57@tcp:101:mkdir.0 Request processed in 801us (4000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.995900:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:0.0:1788574390.657249:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574391.684185:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788574392.028557:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5767af78-1871-405c-8c59-f96bc15eec86 00000100:00100000:3.0:1788574392.578748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574392.580153:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742208 00000100:00100000:0.0:1788574392.580176:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742208 00000100:00100000:0.0:1788574392.580310:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788574392.580331:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+7:13834:x1875455727742208:12345-192.168.201.57@tcp:41:lfs.0 00000004:00000024:0.0:1788574392.580421:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788574392.580555:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+7:13834:x1875455727742208:12345-192.168.201.57@tcp:41:lfs.0 Request processed in 227us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.580583:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574392.586293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00080000:2.0:1788574392.587010:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574392.587032:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742336 00000100:00100000:2.0:1788574392.587042:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742336 00000100:00100000:2.0:1788574392.587116:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574392.587133:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5767af78-1871-405c-8c59-f96bc15eec86+5:13834:x1875455727742336:12345-192.168.201.57@tcp:13:lfs.0 00002000:00000024:2.0:1788574392.587192:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574392.587308:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5767af78-1871-405c-8c59-f96bc15eec86+5:13834:x1875455727742336:12345-192.168.201.57@tcp:13:lfs.0 Request processed in 181us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574392.587335:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00080000:1.0:1788574392.587680:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574392.592273:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574392.594256:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742464 00000100:00100000:2.0:1788574392.594272:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742464 00000100:00100000:2.0:1788574392.594417:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574392.594441:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5767af78-1871-405c-8c59-f96bc15eec86+6:13834:x1875455727742464:12345-192.168.201.57@tcp:13:lfs.0 00002000:00000024:2.0:1788574392.594494:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574392.594789:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5767af78-1871-405c-8c59-f96bc15eec86+6:13834:x1875455727742464:12345-192.168.201.57@tcp:13:lfs.0 Request processed in 360us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574392.594797:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00080000:1.0:1788574392.595144:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788574392.705588:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574392.932703:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574392.932848:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742592 00000100:00100000:1.0:1788574392.932860:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742592 00000100:00100000:1.0:1788574392.932923:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:1.0:1788574392.932948:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+10:13864:x1875455727742592:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574392.932967:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574392.932986:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21c00/0x10531a153b536ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3bc6 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.933026:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21c00/0x10531a153b536ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bc6 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.933038:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21c00/0x10531a153b536ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bc6 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.933047:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21c00, rc 0) 00000100:00100000:1.0:1788574392.933106:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+11:13864:x1875455727742592:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 160us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574392.933113:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:3.0:1788574392.950925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574392.951240:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742720 00000100:00100000:1.0:1788574392.951251:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742720 00000100:00100000:1.0:1788574392.951315:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:1.0:1788574392.951326:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+11:13864:x1875455727742720:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788574392.951716:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+11:13864:x1875455727742720:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 391us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574392.951725:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:3.0:1788574392.965767:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574392.965906:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742848 00000100:00100000:0.0:1788574392.965916:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742848 00000100:00100000:0.0:1788574392.965965:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:0.0:1788574392.965975:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+11:13864:x1875455727742848:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574392.966220:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+11:13864:x1875455727742848:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 246us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.966228:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:0.0:1788574393.010870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.010973:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727742976 00000100:00100000:2.0:1788574393.010984:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727742976 00000100:00100000:2.0:1788574393.011043:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:2.0:1788574393.011055:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+11:13873:x1875455727742976:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574393.011344:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+11:13873:x1875455727742976:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 289us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.011353:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:3.0:1788574393.092037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574393.092767:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743104 00000100:00100000:1.0:1788574393.092778:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743104 00000100:00100000:1.0:1788574393.092846:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:1.0:1788574393.092858:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+11:13873:x1875455727743104:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574393.097622:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+11:13873:x1875455727743104:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 4743us (5573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.097640:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:3.0:1788574393.113750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574393.114012:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743232 00000100:00100000:0.0:1788574393.114022:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743232 00000100:00100000:0.0:1788574393.114091:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:0.0:1788574393.114101:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+11:13864:x1875455727743232:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788574393.114122:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574393.114156:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116a000/0x10531a153b536cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3bf0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.114192:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a000/0x10531a153b536cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf0 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.114205:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116a000/0x10531a153b536cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf0 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.114217:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a000, rc 0) 00000100:00100000:0.0:1788574393.114301:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+12:13864:x1875455727743232:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 201us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.114329:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:0.0:1788574393.125011:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.125343:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743360 00000100:00100000:2.0:1788574393.125355:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743360 00000100:00100000:2.0:1788574393.125441:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:2.0:1788574393.125452:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+12:13864:x1875455727743360:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788574393.125488:0:14339:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788574393.125520:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574393.125525:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788574393.125528:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788574393.125530:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788574393.130552:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+12:13864:x1875455727743360:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 5088us (5552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.130568:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:0.0:1788574393.137785:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.137884:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743488 00000100:00100000:2.0:1788574393.137893:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743488 00000100:00100000:2.0:1788574393.137943:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:2.0:1788574393.137953:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+12:13864:x1875455727743488:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574393.137968:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574393.137983:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3bf7 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.138008:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.138019:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.138029:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985400, rc 0) 00000100:00100000:2.0:1788574393.138078:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:13864:x1875455727743488:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.138084:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:0.0:1788574393.141439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.141569:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743616 00000100:00100000:2.0:1788574393.141582:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743616 00000100:00100000:2.0:1788574393.141659:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:2.0:1788574393.141671:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:13864:x1875455727743616:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574393.142470:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:13864:x1875455727743616:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 785us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.142480:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:1.0:1788574393.153694:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574393.153847:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743744 00000100:00100000:0.0:1788574393.153860:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743744 00000100:00100000:0.0:1788574393.153959:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788574393.153971:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13864:x1875455727743744:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574393.154229:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13864:x1875455727743744:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 257us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.154244:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788574393.160759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.161579:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727743872 00000100:00100000:2.0:1788574393.161659:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727743872 00000100:00100000:2.0:1788574393.161783:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:2.0:1788574393.161795:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:13877:x1875455727743872:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574393.162198:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:13877:x1875455727743872:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 404us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.162208:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:2.0:1788574393.178087:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574393.178238:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744000 00000100:00100000:0.0:1788574393.178250:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744000 00000100:00100000:0.0:1788574393.178311:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:0.0:1788574393.178323:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb2cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13877:x1875455727744000:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574393.178636:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb2cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13877:x1875455727744000:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 315us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.178646:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:1.0:1788574393.187539:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.187790:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744128 00000100:00100000:2.0:1788574393.187800:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744128 00000100:00100000:2.0:1788574393.187848:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574393.187857:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875455727744128:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788574393.187891:0:14346:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5bc00dcd-c724-4b6b-a75b-9c8606e9461b@192.168.201.57@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1788574393.187934:0:14346:0:(genops.c:1385:class_connect()) connect: client 5bc00dcd-c724-4b6b-a75b-9c8606e9461b, cookie 0x10531a153b536ce4 00000004:00100000:2.0:1788574393.187967:0:14346:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788574393.188107:0:14346:0:(import.c:65:import_set_state_nolock()) ffff90a68134b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574393.188174:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2352:x1875455727744128:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 316us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.188181:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788574393.210849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574393.210897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574393.210929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574393.210960:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574393.210988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574393.211031:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744384 00000100:00100000:3.0:1788574393.211041:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744384 00000100:00100000:3.0:1788574393.211107:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744256 00000100:00100000:3.0:1788574393.211111:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744256 00000100:00100000:3.0:1788574393.211135:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744768 00000100:00100000:3.0:1788574393.211138:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744768 00000100:00100000:3.0:1788574393.211152:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574393.211162:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+7:2356:x1875455727744384:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574393.211240:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+7:2356:x1875455727744384:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 78us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.211248:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574393.211266:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574393.211273:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+7:0:x1875455727744256:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574393.211308:0:14346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788574393.211361:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+7:0:x1875455727744256:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 88us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.211404:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574393.211418:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574393.211425:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13864:x1875455727744768:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574393.211435:0:14346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788574393.211458:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13864:x1875455727744768:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 34us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.211475:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00080000:3.0:1788574393.211496:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574393.211896:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744640 00000100:00100000:1.0:1788574393.211902:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744640 00000100:00100000:1.0:1788574393.211932:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744512 00000100:00100000:1.0:1788574393.211935:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744512 00000100:00100000:1.0:1788574393.211948:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788574393.211954:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:2356:x1875455727744640:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574393.211984:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:2356:x1875455727744640:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.212001:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788574393.212012:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788574393.212018:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727744512:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574393.212037:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727744512:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 20us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.212043:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574393.216296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574393.216544:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727744896 00000100:00100000:2.0:1788574393.216555:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727744896 00000100:00100000:2.0:1788574393.216616:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574393.216640:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13864:x1875455727744896:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788574393.216727:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13864:x1875455727744896:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 89us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.216734:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788574393.229660:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574393.229746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574393.229823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574393.230098:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745024 00000100:00100000:3.0:1788574393.230116:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745024 00000100:00100000:3.0:1788574393.230192:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745152 00000100:00100000:3.0:1788574393.230222:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745152 00000100:00100000:3.0:1788574393.230260:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574393.230273:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727745024:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574393.230313:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5bc00dcd-c724-4b6b-a75b-9c8606e9461b@192.168.201.57@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1788574393.230359:0:15029:0:(genops.c:1385:class_connect()) connect: client 5bc00dcd-c724-4b6b-a75b-9c8606e9461b, cookie 0x10531a153b536ceb 00002000:00100000:3.0:1788574393.230411:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5bc00dcd-c724-4b6b-a75b-9c8606e9461b/ffff90a683b2d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574393.230429:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574393.230774:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788574393.230831:0:15029:0:(import.c:65:import_set_state_nolock()) ffff90a683b2b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574393.230935:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2352:x1875455727745024:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 663us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.230943:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574393.230964:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574393.230969:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727745152:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574393.230990:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5bc00dcd-c724-4b6b-a75b-9c8606e9461b@192.168.201.57@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1788574393.231026:0:15029:0:(genops.c:1385:class_connect()) connect: client 5bc00dcd-c724-4b6b-a75b-9c8606e9461b, cookie 0x10531a153b536cf2 00002000:00100000:3.0:1788574393.231039:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5bc00dcd-c724-4b6b-a75b-9c8606e9461b/ffff90a683b2b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574393.231052:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574393.231164:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788574393.231191:0:15029:0:(import.c:65:import_set_state_nolock()) ffff90a683b29000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574393.231237:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2352:x1875455727745152:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 264us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.231250:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:2.0:1788574393.231998:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745280 00000100:00100000:2.0:1788574393.232014:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745280 00000100:00100000:2.0:1788574393.232115:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:2.0:1788574393.232131:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13864:x1875455727745280:12345-192.168.201.57@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788574393.232245:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788574393.232593:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13864:x1875455727745280:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 465us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.232601:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788574393.472980:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747661568:0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.473079:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574393.473144:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574393.473150:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747661440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.473176:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574393.473216:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661568 00000100:00100000:3.0:1788574393.473224:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661568 00000100:00100000:3.0:1788574393.473276:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574393.473285:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747661568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.473349:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747661568:12345-0@lo:400:kworker.0 Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.473357:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574393.473359:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747661312:0@lo:400:kworker.0 00000100:00100000:0.0:1788574393.473405:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574393.473413:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747661568:0@lo:400:kworker.0 00000100:00100000:0.0:1788574393.473428:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747661824:0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.473442:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661440 00000100:00100000:3.0:1788574393.473445:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661440 00000100:00100000:0.0:1788574393.473453:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574393.473482:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574393.473487:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747661184:0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.473492:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661312 00000100:00100000:3.0:1788574393.473494:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661312 00000100:00100000:0.0:1788574393.473512:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574393.473531:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747661696:0@lo:400:kworker.0 00000100:00100000:0.0:1788574393.473550:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574393.473582:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574393.473603:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747661440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574393.473639:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747661440:12345-0@lo:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.473646:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574393.473668:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788574393.473679:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747661440:0@lo:400:kworker.0 00000100:00080000:0.0:1788574393.473707:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574393.473721:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661824 00000100:00100000:0.0:1788574393.473724:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661824 00000100:00100000:0.0:1788574393.473750:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661696 00000100:00100000:0.0:1788574393.473753:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661696 00000100:00100000:0.0:1788574393.473768:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574393.473774:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747661824:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788574393.473781:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574393.473795:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574393.473802:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747661696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.474014:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574393.474020:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747661312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574393.474061:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747661952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574393.479181:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747661696:12345-0@lo:400:kworker.0 Request processed in 5367us (5615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.479200:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788574393.479261:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574393.479488:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747661824:12345-0@lo:400:kworker.0 Request processed in 5712us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.479496:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574393.479568:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747661696:0@lo:400:kworker.0 00000100:00100000:1.0:1788574393.479588:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747661824:0@lo:400:kworker.0 00000100:00100000:1.0:1788574393.479649:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661184 00000100:00100000:1.0:1788574393.479673:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661184 00000100:00100000:1.0:1788574393.479716:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574393.479724:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3313:x1875455747661184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574393.479780:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3313:x1875455747661184:12345-0@lo:400:kworker.0 Request processed in 57us (6266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.479787:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574393.479823:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747661184:0@lo:400:kworker.0 00000100:00100000:3.0:1788574393.480185:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747661312:12345-0@lo:400:kworker.0 Request processed in 6164us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.480195:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574393.480293:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574393.480587:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747661952 00000100:00100000:3.0:1788574393.480592:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747661952 00000100:00100000:3.0:1788574393.480630:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574393.480638:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747661952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574393.480657:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574393.480696:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747661952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.480709:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574393.480783:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747661952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574393.482622:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747661312:0@lo:400:kworker.0 00000001:00100000:1.0:1788574393.561268:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000001:00100000:1.0:1788574393.561287:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5767af78-1871-405c-8c59-f96bc15eec86 00000100:00100000:0.0:1788574393.591450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574393.591647:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745408 00000100:00100000:1.0:1788574393.591661:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745408 00000100:00100000:1.0:1788574393.591729:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788574393.591739:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:13898:x1875455727745408:12345-192.168.201.57@tcp:101:mkdir.0 00010000:00010000:1.0:1788574393.591761:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574393.591790:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c21 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.591859:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.591874:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.591890:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574393.591940:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788574393.591958:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574393.591990:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.592015:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20200/0x10531a153b536cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.592029:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.592035:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:1.0:1788574393.592037:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574393.592040:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20800, rc 0) 00000100:00100000:1.0:1788574393.597731:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+7:13898:x1875455727745408:12345-192.168.201.57@tcp:101:mkdir.0 Request processed in 2754us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.597748:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00010000:00010000:0.0:1788574393.731230:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574393.984640:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574393.984669:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747662080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574393.984759:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574393.985354:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662080 00000100:00100000:2.0:1788574393.985364:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662080 00000100:00100000:2.0:1788574393.985457:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574393.985470:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747662080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574393.985509:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574393.985581:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747662080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.985589:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574393.985801:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747662080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574394.761739:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788574395.075860:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5767af78-1871-405c-8c59-f96bc15eec86 00000001:00100000:0.0:1788574395.075887:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00010000:00010000:1.0:1788574395.780498:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574396.289172:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574396.800659:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788574397.132991:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000001:02000400:1.0:1788574397.413114:0:16315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788574397.829280:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574398.258261:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258314:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258419:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258450:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258511:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574398.258542:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745792 00000100:00100000:2.0:1788574398.258554:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745792 00000100:00100000:2.0:1788574398.258614:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746304 00000100:00100000:2.0:1788574398.258618:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746304 00000100:00100000:2.0:1788574398.258631:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745920 00000100:00100000:2.0:1788574398.258633:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745920 00000100:00100000:2.0:1788574398.258642:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746176 00000100:00100000:2.0:1788574398.258644:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746176 00000100:00100000:2.0:1788574398.258658:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574398.258668:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2355:x1875455727745792:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574398.258745:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2355:x1875455727745792:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 78us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574398.258753:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788574398.258769:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574398.258776:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2355:x1875455727746304:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574398.258799:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2355:x1875455727746304:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574398.258822:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:0.0:1788574398.259084:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746048 00000100:00100000:0.0:1788574398.259089:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746048 00000100:00100000:0.0:1788574398.259119:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745664 00000100:00100000:0.0:1788574398.259122:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745664 00000100:00100000:0.0:1788574398.259140:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574398.259146:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727746048:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574398.259179:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727746048:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 34us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.259185:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574398.259197:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574398.259203:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+6:2355:x1875455727745664:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574398.259224:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+6:2355:x1875455727745664:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 22us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.259230:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788574398.259720:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574398.259729:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2355:x1875455727745920:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574398.259769:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2355:x1875455727745920:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 43us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574398.259776:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574398.259788:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574398.259794:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2355:x1875455727746176:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574398.259825:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2355:x1875455727746176:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 32us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574398.259831:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574398.260310:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727745536 00000100:00100000:1.0:1788574398.260317:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727745536 00000100:00100000:1.0:1788574398.260356:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 106 00000100:00100000:1.0:1788574398.260362:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:2355:x1875455727745536:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788574398.260511:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574398.260516:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574398.260518:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574398.262417:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786936850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:2355:x1875455727745536:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 2041us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574398.262430:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 106 00000100:00100000:3.0:1788574398.594469:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574398.594500:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747662208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574398.594587:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574398.594688:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662208 00000100:00100000:3.0:1788574398.594696:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662208 00000100:00100000:3.0:1788574398.594752:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574398.594761:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747662208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574398.594795:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574398.594864:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747662208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574398.594872:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788574398.594894:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574398.595054:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747662208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574398.595922:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747662464:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.595967:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574398.595998:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574398.596004:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747662592:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596027:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574398.596057:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662464 00000100:00100000:0.0:1788574398.596063:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662464 00000100:00100000:0.0:1788574398.596103:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574398.596119:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747662464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596161:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747662464:12345-0@lo:400:kworker.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.596168:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574398.596186:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662592 00000100:00100000:0.0:1788574398.596190:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662592 00000100:00100000:0.0:1788574398.596215:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574398.596221:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747662592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596263:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747662592:12345-0@lo:400:kworker.0 Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.596268:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788574398.596287:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574398.596309:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747662592:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596317:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747662464:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596338:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747662336:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596395:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574398.596428:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747662848:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596450:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574398.596468:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574398.596473:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747662720:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596492:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574398.596516:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662848 00000100:00100000:0.0:1788574398.596520:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662848 00000100:00100000:0.0:1788574398.596543:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662720 00000100:00100000:0.0:1788574398.596546:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662720 00000100:00100000:0.0:1788574398.596562:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574398.596576:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747662848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596610:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747662848:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.596616:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574398.596626:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574398.596630:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747662720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596668:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747662720:12345-0@lo:400:kworker.0 Request processed in 38us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.596673:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788574398.596690:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574398.596705:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747662720:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596714:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747662848:0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596747:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662336 00000100:00100000:0.0:1788574398.596750:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662336 00000100:00100000:0.0:1788574398.596771:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574398.596776:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3313:x1875455747662336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574398.596803:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3313:x1875455747662336:12345-0@lo:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574398.596807:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574398.596838:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747662336:0@lo:400:kworker.0 00010000:00010000:0.0:1788574398.849462:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574399.107058:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574399.110978:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747662976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574399.111080:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574399.111994:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747662976 00000100:00100000:3.0:1788574399.112007:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747662976 00000100:00100000:3.0:1788574399.112071:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574399.112082:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747662976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574399.112126:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788574399.112194:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747662976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574399.112201:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574399.112296:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747662976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574399.872799:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574400.896734:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574401.939702:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574402.385779:0:16464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0abc7890 20000000:00000080:3.0:1788574402.385815:0:16464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a682df9000 uarg=0000000000000000 20000000:01000000:3.0:1788574402.385863:0:16464:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574402.385870:0:16464:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574402.385874:0:16464:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788574402.392786:0:16465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788574402.392937:0:16464:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788574402.408639:0:16464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574402.412005:0:16464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412035:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5369f7 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412044:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536a44 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412050:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536b78 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412059:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412066:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412075:0:16464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412507:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412524:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 12 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.412558:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663104:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574402.412677:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.412685:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 12 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.412694:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663232:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574402.416597:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b536b78 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.416618:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b536b78 expref: 18 pid: 14338 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.416634:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663360:0@lo:104: 00000100:00100000:1.0:1788574402.416709:0:16464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574402.417490:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b536a44 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.417503:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b536a44 expref: 18 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.417514:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663488:0@lo:104: 00000100:00100000:1.0:1788574402.417550:0:16464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574402.419500:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5369f7 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.419521:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5369f7 expref: 18 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.419553:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663616:0@lo:104: 00000100:00100000:1.0:1788574402.419616:0:16464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574402.424661:0:16464:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574402.425027:0:14328:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788574402.425053:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663104:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574402.425091:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747663360 00000100:00100000:2.0:1788574402.425123:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747663360 00000100:00100000:2.0:1788574402.425167:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747663488 00000100:00100000:2.0:1788574402.425171:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747663488 00000100:00100000:2.0:1788574402.425184:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747663616 00000100:00100000:2.0:1788574402.425187:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747663616 00000100:00100000:2.0:1788574402.425201:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574402.425210:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+5:16464:x1875455747663360:12345-0@lo:104: 00010000:00010000:2.0:1788574402.425230:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425316:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574402.425322:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+5:16464:x1875455747663360:12345-0@lo:104: Request processed in 113us (8614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574402.425329:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574402.425359:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574402.425384:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+4:16464:x1875455747663488:12345-0@lo:104: 00010000:00010000:2.0:1788574402.425393:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425427:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574402.425432:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+4:16464:x1875455747663488:12345-0@lo:104: Request processed in 68us (7882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574402.425439:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574402.425452:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574402.425458:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bca86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:16464:x1875455747663616:12345-0@lo:104: 00010000:00010000:2.0:1788574402.425465:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425497:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788574402.425509:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bca86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+3:16464:x1875455747663616:12345-0@lo:104: Request processed in 51us (5893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574402.425514:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788574402.425557:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574402.425563:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425572:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20c00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574402.425576:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425585:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574402.425592:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574402.425598:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574402.425643:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425651:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574402.425674:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425681:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a20c00/0x10531a153b536b78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536b7f expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425696:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574402.425700:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425729:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984600 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574402.425732:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425738:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574402.425743:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574402.425748:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574402.425763:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425769:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574402.425786:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425791:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984600/0x10531a153b536a44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b536a4b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425801:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574402.425805:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.425810:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2158400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574402.425813:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426104:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574402.426110:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574402.426115:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574402.426133:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426139:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574402.426146:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426153:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2158400/0x10531a153b5369f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5369fe expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426169:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574402.426171:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574402.426173:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574402.426183:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574402.426189:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574402.426210:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747663744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574402.426251:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574402.426292:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747663872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574402.426326:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574402.426468:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574402.426475:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747664000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574402.426506:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574402.426543:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747663744 00000100:00100000:2.0:1788574402.426548:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747663744 00010000:00010000:2.0:1788574402.426573:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b536b78 expref: 19 pid: 14338 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574402.426592:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747663872 00000100:00100000:2.0:1788574402.426594:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747663872 00010000:00010000:2.0:1788574402.426604:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b536a44 expref: 20 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574402.426613:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664000 00000100:00100000:2.0:1788574402.426615:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664000 00010000:00010000:2.0:1788574402.426626:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5369f7 expref: 21 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574402.426637:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574402.426643:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+21:3315:x1875455747663744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574402.426655:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574402.426660:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b536b78 expref: 21 pid: 14338 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426670:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b536b78 expref: 21 pid: 14338 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426687:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574402.426807:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788574402.426929:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+21:3315:x1875455747663744:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574402.426936:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574402.426952:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574402.426967:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+20:3312:x1875455747663872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574402.426974:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574402.426979:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b536a44 expref: 20 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426988:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b536a44 expref: 20 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.426997:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574402.427034:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+20:3312:x1875455747663872:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574402.427040:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574402.427054:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574402.427061:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7603450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747664000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574402.427068:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574402.427072:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5369f7 expref: 19 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.427080:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5369f7 expref: 19 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574402.427089:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574402.427500:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7603450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747664000:12345-0@lo:103:ldlm_bl.0 Request processed in 438us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574402.427507:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574402.427576:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747663744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574402.427671:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747664000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574402.427679:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747663872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574402.427805:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985c00/0x10531a153b536b7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b536b78 expref: 18 pid: 14338 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574402.427821:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663360:0@lo:104: 00010000:00010000:3.0:1788574402.428000:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159600/0x10531a153b536a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b536a44 expref: 17 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574402.428014:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663488:0@lo:104: 00010000:00010000:3.0:1788574402.428041:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159400/0x10531a153b5369fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5369f7 expref: 16 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574402.428051:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663616:0@lo:104: 00000100:00100000:1.0:1788574402.428575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574402.428675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574402.428706:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746432 00000100:00100000:0.0:1788574402.428863:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875455747663232:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574402.428899:0:16464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.429003:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746432 00010000:00010000:1.0:1788574402.429037:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 13 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.429071:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746560 00000100:00100000:1.0:1788574402.429074:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746560 00010000:00010000:1.0:1788574402.429089:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 14 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574402.429113:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788574402.429121:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+14:2356:x1875455727746432:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574402.429133:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574402.429138:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 14 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429149:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 14 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429165:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985400/0x10531a153b536cdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf7 expref: 14 pid: 14337 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429178:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574402.429239:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+13:2356:x1875455727746432:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 117us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574402.429246:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788574402.429262:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:1.0:1788574402.429268:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+12:2356:x1875455727746560:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574402.429276:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574402.429281:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 12 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429290:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 12 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429309:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21200/0x10531a153b536ca5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b95 expref: 12 pid: 14339 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429321:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429330:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429704:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429785:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429794:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429802:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429815:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574402.429819:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.429894:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574402.448092:0:16464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574402.449228:0:16464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.450219:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.450237:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a20400/0x10531a153b536d07 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574402.450259:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574402.450345:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+11:2356:x1875455727746560:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 21071us (21664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574402.450356:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:2.0:1788574402.944668:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574403.376085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574403.376399:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746816 00000100:00100000:0.0:1788574403.376411:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746816 00000100:00100000:0.0:1788574403.376476:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:0.0:1788574403.376488:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+6:2353:x1875455727746816:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574403.376770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574403.376809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574403.376857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574403.376876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00080000:1.0:1788574403.377010:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574403.377028:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746688 00000100:00100000:1.0:1788574403.377033:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746688 00000100:00100000:1.0:1788574403.377069:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:1.0:1788574403.377077:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+11:2353:x1875455727746688:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574403.377135:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+11:2353:x1875455727746688:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.377143:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:1.0:1788574403.377243:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747072 00000100:00100000:1.0:1788574403.377247:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747072 00000100:00100000:1.0:1788574403.377270:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747328 00000100:00100000:1.0:1788574403.377295:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747328 00000100:00100000:1.0:1788574403.377314:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727746944 00000100:00100000:1.0:1788574403.377316:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727746944 00000100:00100000:1.0:1788574403.377330:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788574403.377337:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727747072:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574403.377387:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727747072:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 29us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.377395:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788574403.377407:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788574403.377413:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727747328:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574403.377437:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727747328:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.377443:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788574403.377453:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788574403.377459:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727746944:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574403.377479:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727746944:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 21us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.377485:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00080000:1.0:1788574403.377498:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574403.377501:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574403.378107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574403.380205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574403.382338:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747200 00000100:00100000:0.0:1788574403.382361:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747200 00000100:00100000:0.0:1788574403.382470:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:0.0:1788574403.382482:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727747200:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574403.382939:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747456 00000100:00100000:3.0:1788574403.382947:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747456 00000100:00100000:3.0:1788574403.382998:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574403.383007:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727747456:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574403.383068:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727747456:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 63us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574403.383077:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788574403.383434:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727747200:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 951us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574403.383446:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00080000:0.0:1788574403.383484:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574403.383491:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574403.384255:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+6:2353:x1875455727746816:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 7763us (8174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.384264:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 10000000:01000000:2.0:1788574403.456580:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574403.456614:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a79fbb6000 from 10 10000000:01000000:2.0:1788574403.456622:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574403.456682:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574403.456812:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574403.456826:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574403.456860:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.457015:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574403.457125:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7923699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574403.462861:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664128 00000100:00100000:0.0:1788574403.462884:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664128 00000100:00100000:1.0:1788574403.463278:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788574403.463303:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:14341:x1875455747664128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574403.463341:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574403.463364:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21200/0x10531a153b536d15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536d0e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.463432:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21200/0x10531a153b536d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536d0e expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.463445:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21200/0x10531a153b536d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536d0e expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.463455:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21200, rc 0) 00000100:00100000:1.0:1788574403.463563:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:14341:x1875455747664128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (6548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.463571:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788574403.463780:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574403.463806:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574403.463818:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574403.463931:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.463974:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574403.464004:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7923699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574403.464272:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664256 00000100:00100000:1.0:1788574403.464278:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664256 00000100:00100000:1.0:1788574403.464328:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788574403.464337:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:14341:x1875455747664256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.466036:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.466111:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.466255:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:14341:x1875455747664256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1545us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574403.466268:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574403.467988:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574403.468073:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7923699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574403.468467:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664384 00000100:00100000:0.0:1788574403.468483:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664384 00000100:00100000:0.0:1788574403.468566:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788574403.468581:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:14341:x1875455747664384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574403.468945:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:14341:x1875455747664384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574403.468953:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788574403.469307:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788574403.470644:0:16485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788574403.471197:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788574403.471227:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574403.471241:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.471280:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574403.471305:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574403.471308:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7bfbe1000 from 10 10000000:01000000:1.0:1788574403.471312:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574403.471360:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.471387:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.471400:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574403.471437:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.471536:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574403.471602:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574403.472346:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664512 00000100:00100000:0.0:1788574403.472355:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664512 00000100:00100000:0.0:1788574403.472448:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788574403.472460:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:14341:x1875455747664512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574403.472477:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574403.472497:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116a200/0x10531a153b536d23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536d1c expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574403.472533:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a200/0x10531a153b536d23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536d1c expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574403.472547:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116a200/0x10531a153b536d23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536d1c expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574403.472558:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a200, rc 0) 00000100:00100000:0.0:1788574403.472617:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747664512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574403.472624:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574403.476953:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574403.476991:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.477004:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574403.477124:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.477199:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574403.477269:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574403.477458:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664640 00000100:00100000:2.0:1788574403.477468:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664640 00000100:00100000:2.0:1788574403.477537:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788574403.477549:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747664640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.478180:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747664640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 620us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574403.478192:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788574403.479104:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.479183:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.479250:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574403.479299:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574403.479438:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664768 00000100:00100000:2.0:1788574403.479447:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664768 00000100:00100000:2.0:1788574403.479498:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788574403.479507:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747664768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.479968:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747664768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 386us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574403.479977:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788574403.480341:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574403.481511:0:16486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788574403.482118:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788574403.482146:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574403.482158:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.482171:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574403.482245:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574403.482249:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a78528f000 from 10 10000000:01000000:1.0:1788574403.482253:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574403.482315:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.482325:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.482339:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574403.482404:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.482489:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574403.482632:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574403.488019:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747664896 00000100:00100000:2.0:1788574403.488036:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747664896 00000100:00100000:3.0:1788574403.489822:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788574403.489837:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:14341:x1875455747664896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574403.489878:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574403.490088:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d6a00/0x10531a153b536d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536d2a expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574403.490123:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d6a00/0x10531a153b536d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536d2a expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574403.490135:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d6a00/0x10531a153b536d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536d2a expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574403.490143:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6a00, rc 0) 00000100:00100000:3.0:1788574403.490237:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747664896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 403us (7748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574403.490244:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788574403.490683:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747664896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574403.490716:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574403.490727:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574403.490813:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747665024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.490855:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574403.491081:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665024 00000100:00100000:2.0:1788574403.491089:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665024 00000100:00100000:2.0:1788574403.491126:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788574403.491134:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747665024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574403.491463:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747665024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574403.491471:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788574403.491626:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574403.491645:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747665024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.491687:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747665152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574403.491748:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574403.491771:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574403.491966:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665152 00000100:00100000:3.0:1788574403.491972:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665152 00000100:00100000:3.0:1788574403.491996:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788574403.492004:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747665152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574403.492165:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:14341:x1875455747665152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574403.492325:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788574403.492598:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:14341:1875455747665152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788574403.493981:0:16487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788574403.494825:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788574403.494855:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574403.494868:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574403.494964:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574403.715365:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747665280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574403.715490:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574403.715569:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665280 00000100:00100000:0.0:1788574403.715577:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665280 00000100:00100000:0.0:1788574403.715639:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574403.715649:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747665280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574403.716314:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574403.716394:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747665280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 745us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574403.716402:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788574403.716428:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574403.716467:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747665280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574403.716774:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747665664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574403.716831:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574403.716868:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574403.716874:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747665536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574403.716897:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574403.716935:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665664 00000100:00100000:3.0:1788574403.716949:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665664 00000100:00100000:3.0:1788574403.716991:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665536 00000100:00100000:3.0:1788574403.716995:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665536 00000100:00100000:3.0:1788574403.717016:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574403.717024:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747665664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574403.717066:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747665664:12345-0@lo:400:kworker.0 Request processed in 44us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574403.717073:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574403.717087:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574403.717093:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747665536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574403.717129:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747665536:12345-0@lo:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574403.717134:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574403.717164:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747665536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574403.717175:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747665664:0@lo:400:kworker.0 00000100:00100000:0.0:1788574403.718109:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747665408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574403.718217:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574403.718255:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574403.718264:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747665792:0@lo:400:kworker.0 00000100:00100000:0.0:1788574403.718302:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574403.718335:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665408 00000100:00100000:0.0:1788574403.718341:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665408 00000100:00100000:0.0:1788574403.718409:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574403.718418:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747665408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574403.718463:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747665408:12345-0@lo:400:kworker.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574403.718470:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788574403.718491:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574403.718495:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574403.718502:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665792 00000100:00100000:0.0:1788574403.718505:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665792 00000100:00100000:0.0:1788574403.718528:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574403.718533:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747665792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574403.718560:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747665792:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574403.718580:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788574403.718594:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574403.718613:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747665792:0@lo:400:kworker.0 00000100:00100000:0.0:1788574403.718622:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747665408:0@lo:400:kworker.0 00010000:00010000:2.0:1788574403.969497:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574404.227742:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574404.227772:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747665920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574404.227867:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574404.227987:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747665920 00000100:00100000:2.0:1788574404.227997:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747665920 00000100:00100000:2.0:1788574404.228070:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574404.228082:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747665920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574404.228130:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574404.228200:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747665920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574404.228208:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574404.228265:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747665920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574404.341592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574404.343698:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747584 00000100:00100000:0.0:1788574404.343717:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747584 00000100:00100000:0.0:1788574404.343784:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:0.0:1788574404.343794:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+11:13751:x1875455727747584:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574404.343812:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574404.343832:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116b400/0x10531a153b536d38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c28 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574404.343864:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116b400/0x10531a153b536d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c28 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574404.343878:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116b400/0x10531a153b536d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c28 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574404.343889:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116b400, rc 0) 00000100:00100000:0.0:1788574404.343956:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+12:13751:x1875455727747584:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 163us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574404.343963:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:3.0:1788574404.346610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574404.346694:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747712 00000100:00100000:0.0:1788574404.346704:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747712 00000100:00100000:0.0:1788574404.346760:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:0.0:1788574404.346770:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+12:13751:x1875455727747712:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574404.347151:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+12:13751:x1875455727747712:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 381us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574404.347160:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:0.0:1788574404.352866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574404.352952:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747840 00000100:00100000:3.0:1788574404.352966:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747840 00000100:00100000:3.0:1788574404.353038:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:3.0:1788574404.353051:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+12:13751:x1875455727747840:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574404.353483:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+12:13751:x1875455727747840:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 434us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574404.353492:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:0.0:1788574404.380390:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574404.380487:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727747968 00000100:00100000:3.0:1788574404.380500:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727747968 00000100:00100000:3.0:1788574404.380620:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:3.0:1788574404.380645:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+12:13751:x1875455727747968:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574404.380670:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574404.380696:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7829d7000/0x10531a153b536d3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c2f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574404.380734:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7829d7000/0x10531a153b536d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c2f expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574404.380748:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7829d7000/0x10531a153b536d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c2f expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574404.380760:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d7000, rc 0) 00000100:00100000:3.0:1788574404.380844:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13751:x1875455727747968:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 200us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574404.380852:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:3.0:1788574404.382628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574404.382688:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748096 00000100:00100000:0.0:1788574404.382701:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748096 00000100:00100000:0.0:1788574404.382755:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:0.0:1788574404.382767:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:13751:x1875455727748096:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574404.383122:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:13751:x1875455727748096:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 356us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574404.383132:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:2.0:1788574404.386291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574404.386346:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748224 00000100:00100000:2.0:1788574404.386358:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748224 00000100:00100000:2.0:1788574404.386443:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:2.0:1788574404.386455:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13751:x1875455727748224:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574404.386773:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:13751:x1875455727748224:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 319us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574404.386783:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 123 00010000:00010000:3.0:1788574404.992929:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574406.016931:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574406.531414:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574406.811194:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574406.811357:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748352 00000100:00100000:0.0:1788574406.811394:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748352 00000100:00100000:0.0:1788574406.811512:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788574406.811525:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:14408:x1875455727748352:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574406.811546:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574406.811572:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c36 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.811651:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.811668:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.811705:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.811722:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.811729:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.811736:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812242:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b536d5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812254:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b536d5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812261:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b536d5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574406.812296:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574406.812300:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574406.812333:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b536d5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812343:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812349:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812402:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812409:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ae00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574406.812412:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812420:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812433:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:0.0:1788574406.812436:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574406.812441:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812448:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812461:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812467:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812473:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812478:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574406.812481:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812497:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812505:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a7b2398100) 00010000:00010000:0.0:1788574406.812508:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574406.812511:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812517:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536d54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812559:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c36 expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812574:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b536d5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c36 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.812582:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7b2398d00) 00010000:00010000:0.0:1788574406.812585:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574406.812587:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116b800, rc 0) 00000100:00100000:0.0:1788574406.812669:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+7:14408:x1875455727748352:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574406.812677:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00080000:2.0:1788574406.814080:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574406.816504:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574406.816598:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748608 00000100:00100000:0.0:1788574406.816608:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748608 00000100:00100000:0.0:1788574406.816707:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:0.0:1788574406.816718:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+7:14408:x1875455727748608:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574406.816758:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574406.816782:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536d62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c3d expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.816859:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.816874:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.816886:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.816937:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.816945:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.816953:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817314:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b536d77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817324:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b536d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817332:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b536d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574406.817341:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788574406.817600:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817610:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817617:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817623:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574406.817628:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817636:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817649:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7b2398d00) 00010000:00010000:0.0:1788574406.817652:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574406.817658:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817664:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536d69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817676:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817682:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817688:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817702:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574406.817705:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817711:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817718:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a7b2398a00) 00010000:00010000:0.0:1788574406.817720:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574406.817723:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.817728:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536d70 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.818212:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536d62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c3d expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.818260:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b536d77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c3d expref: 9 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.818268:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:0.0:1788574406.818270:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574406.818273:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116be00, rc 0) 00000100:00100000:0.0:1788574406.818346:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+9:14408:x1875455727748608:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1630us (1855us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788574406.818354:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788574406.829149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574406.829239:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748736 00000100:00100000:1.0:1788574406.829250:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748736 00000100:00100000:1.0:1788574406.829316:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:1.0:1788574406.829328:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+9:14408:x1875455727748736:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788574406.829455:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+9:14408:x1875455727748736:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574406.829478:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:2.0:1788574406.864689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574406.864794:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748864 00000100:00100000:3.0:1788574406.864806:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748864 00000100:00100000:3.0:1788574406.864873:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788574406.864885:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+9:14414:x1875455727748864:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574406.864907:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574406.864935:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536d85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c44 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865012:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865044:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865059:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865078:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865085:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865105:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865357:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865413:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865422:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865429:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574406.865434:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865443:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865457:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:3.0:1788574406.865466:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574406.865472:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865479:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865493:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865499:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865505:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865510:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574406.865513:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865520:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865528:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a784e37100) 00010000:00010000:3.0:1788574406.865531:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574406.865534:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865540:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536d93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865572:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536d85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c44 expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865589:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:3.0:1788574406.865591:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574406.865595:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536d85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c44 expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.865605:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6e00, rc 0) 00000100:00100000:3.0:1788574406.865676:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+9:14414:x1875455727748864:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 793us (999us total) trans 0 rc 301/301 00000100:00100000:3.0:1788574406.865683:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788574406.871544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574406.871689:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727748992 00000100:00100000:1.0:1788574406.871705:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727748992 00000100:00100000:1.0:1788574406.871783:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788574406.871794:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5767af78-1871-405c-8c59-f96bc15eec86+9:14414:x1875455727748992:12345-192.168.201.57@tcp:700:lfs.0 00000100:00100000:1.0:1788574406.871922:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5767af78-1871-405c-8c59-f96bc15eec86+9:14414:x1875455727748992:12345-192.168.201.57@tcp:700:lfs.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574406.871930:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788574406.875702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574406.875807:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727749248 00000100:00100000:1.0:1788574406.875817:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727749248 00000100:00100000:1.0:1788574406.876028:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:1.0:1788574406.876039:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+9:14414:x1875455727749248:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:1.0:1788574406.876103:0:15051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574406.876130:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984a00/0x10531a153b536cc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bbf expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574406.876153:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:1.0:1788574406.876158:0:15051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574406.876445:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574406.876461:0:15051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 5 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574406.876470:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574406.876515:0:15051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 5 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574406.876528:0:15051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 5 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574406.876543:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15051:1875455747666048:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574406.876642:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574406.880447:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574406.880571:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15051:1875455747666048:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574406.880605:0:15051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574406.880796:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727749376 00000100:00100000:0.0:1788574406.880815:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727749376 00010000:00010000:0.0:1788574406.880974:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 6 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574406.881020:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788574406.881032:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727749376:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574406.881052:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574406.881060:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 6 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.881072:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 6 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.881095:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20800/0x10531a153b536d00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c21 expref: 6 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.881115:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:0.0:1788574406.881120:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.881131:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.881139:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.881170:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574406.881234:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2355:x1875455727749376:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 194us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574406.881256:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00010000:00010000:3.0:1788574406.881325:0:15051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.881343:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.881390:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.881401:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.881408:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574406.882696:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788574406.882714:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.882724:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.882737:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.882744:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574406.882749:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.882758:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.882773:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a782d70d00) 00010000:00010000:3.0:1788574406.882775:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574406.882780:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.882787:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20c00/0x10531a153b536d9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574406.882810:0:15051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a33a457 reply state 0000000099f2e46e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574406.882819:0:15051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574406.882911:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+10:14414:x1875455727749248:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 6870us (7217us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788574406.882919:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00080000:2.0:1788574406.883583:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574406.888298:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.888316:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.888323:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.888340:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574406.888345:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.888353:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.888413:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a784e37100) 00010000:00010000:0.0:1788574406.888417:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574406.888423:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574406.888429:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536da1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574406.975237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574406.978002:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727749504 00000100:00100000:3.0:1788574406.978022:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727749504 00000100:00100000:3.0:1788574406.978177:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788574406.978189:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+9:14422:x1875455727749504:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:3.0:1788574406.978252:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574406.978282:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c4b expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.978362:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536daf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.978402:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.978417:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574406.978464:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574406.978468:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574406.978508:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.978532:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c4b expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.978556:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c4b expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574406.978565:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:3.0:1788574406.978568:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574406.978572:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6200, rc 0) 00000100:00100000:3.0:1788574406.978662:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+10:14422:x1875455727749504:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 475us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574406.978678:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788574407.011655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.011873:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727749632 00000100:00100000:0.0:1788574407.011885:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727749632 00000100:00100000:0.0:1788574407.011959:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574407.011970:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:14424:x1875455727749632:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574407.011997:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574407.012042:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c52 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.012299:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536dbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.012314:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.012341:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574407.012413:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574407.012417:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574407.012439:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.012464:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c52 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.012484:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c52 expref: 6 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.012493:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:0.0:1788574407.012496:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574407.012501:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116b600, rc 0) 00000100:00100000:0.0:1788574407.012565:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:14424:x1875455727749632:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 596us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574407.012572:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:2.0:1788574407.019629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.020098:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727749760 00000100:00100000:0.0:1788574407.020132:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727749760 00000100:00100000:0.0:1788574407.020195:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574407.020208:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:14424:x1875455727749760:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574407.020353:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574407.020415:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c59 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020508:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020527:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020545:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020563:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020571:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020578:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020692:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536dd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020701:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020709:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574407.020756:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574407.020761:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574407.020789:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020803:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020811:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020819:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020836:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116aa00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.020842:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020853:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020869:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:0.0:1788574407.020873:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574407.020880:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020887:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020909:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020927:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020934:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020940:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.020943:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020950:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020959:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7b2398a00) 00010000:00010000:0.0:1788574407.020961:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574407.020964:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.020971:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b536dd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.021010:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b000/0x10531a153b536dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c59 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.021026:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c59 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.021034:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7b2398100) 00010000:00010000:0.0:1788574407.021036:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574407.021045:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ae00, rc 0) 00000100:00100000:0.0:1788574407.021441:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+7:14424:x1875455727749760:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1233us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574407.021450:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:2.0:1788574407.030684:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.030771:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727750016 00000100:00100000:3.0:1788574407.030783:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727750016 00000100:00100000:3.0:1788574407.030851:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788574407.030862:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+7:14424:x1875455727750016:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574407.030882:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574407.030904:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c60 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574407.031001:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788574407.031123:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536de0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c60 expref: 9 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.031137:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:3.0:1788574407.031140:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574407.031146:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c60 expref: 9 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.031159:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6800, rc 0) 00000100:00100000:3.0:1788574407.031217:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+8:14424:x1875455727750016:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 357us (543us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788574407.031232:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:2.0:1788574407.034076:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.034210:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727750272 00000100:00100000:3.0:1788574407.034220:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727750272 00000100:00100000:3.0:1788574407.034287:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788574407.034296:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+8:14424:x1875455727750272:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:3.0:1788574407.034409:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574407.034437:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b536dd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c59 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.034456:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7b2398100) 00010000:00010000:3.0:1788574407.034467:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574407.034493:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.034506:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.034516:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574407.034730:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025abc8f8 reply state 000000002ff1e40b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574407.034739:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788574407.034748:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788574407.034906:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+9:14424:x1875455727750272:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 609us (838us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788574407.034914:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00010000:00010000:0.0:1788574407.037850:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.037870:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.037878:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.037884:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d7400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.037889:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.037898:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.037915:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37400) 00010000:00010000:0.0:1788574407.037918:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788574407.037923:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.037929:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d7400/0x10531a153b536dee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574407.038250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.038595:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727750528 00000100:00100000:0.0:1788574407.038605:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727750528 00000100:00100000:0.0:1788574407.038657:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788574407.038668:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+8:14424:x1875455727750528:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788574407.039056:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+9:14424:x1875455727750528:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 389us (811us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788574407.039064:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00010000:00010000:2.0:1788574407.040565:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574407.041437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.041597:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727750784 00000100:00100000:3.0:1788574407.041609:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727750784 00000100:00100000:3.0:1788574407.041669:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788574407.041680:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+9:14424:x1875455727750784:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574407.041704:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574407.041724:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c67 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.041825:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.041843:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.041857:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.041875:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.041883:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.041890:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574407.042010:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788574407.042114:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042123:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042130:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042137:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7829d6e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574407.042141:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042160:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042173:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:3.0:1788574407.042176:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574407.042181:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042188:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6e00/0x10531a153b536dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042200:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042207:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042213:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042220:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2158400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574407.042233:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042240:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042247:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a784e37b00) 00010000:00010000:3.0:1788574407.042250:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574407.042253:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042270:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042310:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536df5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c67 expref: 11 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042322:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:3.0:1788574407.042325:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574407.042329:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6800/0x10531a153b536df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c67 expref: 11 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.042338:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7829d6800, rc 0) 00000100:00100000:3.0:1788574407.042691:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+10:14424:x1875455727750784:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1011us (1261us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788574407.042699:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:2.0:1788574407.063673:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.063856:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727750912 00000100:00100000:3.0:1788574407.063868:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727750912 00000100:00100000:3.0:1788574407.063944:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:3.0:1788574407.063955:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+10:14424:x1875455727750912:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574407.063980:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574407.064006:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c6e expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.064105:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.064119:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.064143:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574407.064170:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574407.064174:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574407.064191:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.064233:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.064256:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.064266:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574407.064270:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574407.064274:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c2159400, rc 0) 00000100:00100000:3.0:1788574407.064346:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:14424:x1875455727750912:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 392us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574407.064353:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:2.0:1788574407.071135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.071261:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727751040 00000100:00100000:0.0:1788574407.071275:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727751040 00000100:00100000:0.0:1788574407.071340:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:0.0:1788574407.071351:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:14424:x1875455727751040:12345-192.168.201.57@tcp:37:lfs.0 00000100:00100000:1.0:1788574407.080821:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:14424:x1875455727751040:12345-192.168.201.57@tcp:37:lfs.0 Request processed in 9450us (9675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574407.081649:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:2.0:1788574407.089274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.089412:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727751296 00000100:00100000:0.0:1788574407.089423:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727751296 00000100:00100000:0.0:1788574407.089473:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:0.0:1788574407.089483:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78636d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:14424:x1875455727751296:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788574407.089732:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78636d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+12:14424:x1875455727751296:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 249us (468us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788574407.089740:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574407.178146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.178303:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727751424 00000100:00100000:0.0:1788574407.178314:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727751424 00000100:00100000:0.0:1788574407.178403:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:0.0:1788574407.178415:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+10:14430:x1875455727751424:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574407.178436:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574407.178457:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c75 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178525:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178538:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178564:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178580:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178587:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178593:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178680:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b536e34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178687:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b536e34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178694:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b536e34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574407.178719:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574407.178722:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574407.178757:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b536e34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178769:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178776:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178792:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178798:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.178802:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178809:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178821:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:0.0:1788574407.178824:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574407.178829:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178835:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178855:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178861:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178867:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178873:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ba00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.178875:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178889:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178896:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7b2398a00) 00010000:00010000:0.0:1788574407.178899:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574407.178901:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178907:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178935:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116aa00/0x10531a153b536e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c75 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178947:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b536e34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c75 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.178954:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:0.0:1788574407.178956:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574407.178959:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116b200, rc 0) 00000100:00100000:0.0:1788574407.179018:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+11:14430:x1875455727751424:12345-192.168.201.57@tcp:101:bash.0 Request processed in 605us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574407.179025:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788574407.189062:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.189395:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727751680 00000100:00100000:3.0:1788574407.189404:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727751680 00000100:00100000:3.0:1788574407.189461:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788574407.189471:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+11:14430:x1875455727751680:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788574407.189490:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574407.189511:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e3b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c7c expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.189647:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.189662:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.189671:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.189704:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.189718:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 11 pid: 14346 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574407.189732:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1875455747666176:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574407.189978:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574407.194183:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1875455747666176:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574407.194226:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574407.196712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574407.196941:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727751808 00000100:00100000:1.0:1788574407.196956:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727751808 00010000:00010000:1.0:1788574407.197023:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 12 pid: 14346 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574407.197076:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788574407.197096:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+12:2355:x1875455727751808:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574407.197112:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574407.197120:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 12 pid: 14346 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.197163:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 12 pid: 14346 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.197187:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159400/0x10531a153b536e18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c6e expref: 12 pid: 14346 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.197209:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:1.0:1788574407.197215:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.197238:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.197247:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.197281:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574407.197350:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:2355:x1875455727751808:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 264us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574407.197357:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00010000:00010000:3.0:1788574407.197949:0:14346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.197960:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.197988:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.198010:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.198021:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.199244:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.199261:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.199272:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574407.199284:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788574407.199312:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.199320:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200292:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200306:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574407.200312:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200322:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200354:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574407.200357:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574407.200363:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200819:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159600/0x10531a153b536e42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574407.200907:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef270292 reply state 00000000c78796de transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574407.200918:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788574407.200970:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2158400/0x10531a153b536e3b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200987:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.200995:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574407.200998:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788574407.201000:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165aa00, rc 0) 00000100:00100000:3.0:1788574407.201248:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+14:14430:x1875455727751680:12345-192.168.201.57@tcp:101:bash.0 Request processed in 11775us (12193us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788574407.201258:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00010000:00010000:0.0:1788574407.208055:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.208079:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.208122:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.208136:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.208142:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.208152:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.208175:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90a784e37000) 00010000:00010000:0.0:1788574407.208179:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574407.208185:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.208194:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c2159a00/0x10531a153b536e49 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574407.223725:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.223846:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727751936 00000100:00100000:0.0:1788574407.223862:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727751936 00000100:00100000:0.0:1788574407.223938:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:0.0:1788574407.223952:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+13:14430:x1875455727751936:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574407.223984:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574407.224015:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e5e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c83 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224140:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224167:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224181:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574407.224250:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574407.224255:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574407.224276:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224286:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224311:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e5e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224346:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.224355:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:0.0:1788574407.224358:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574407.224362:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a400, rc 0) 00000100:00100000:0.0:1788574407.224500:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+14:14430:x1875455727751936:12345-192.168.201.57@tcp:101:bash.0 Request processed in 552us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574407.224508:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:2.0:1788574407.229008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.229242:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727752192 00000100:00100000:0.0:1788574407.229253:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727752192 00000100:00100000:0.0:1788574407.229321:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788574407.229354:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+14:14430:x1875455727752192:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:0.0:1788574407.229789:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+15:14430:x1875455727752192:12345-192.168.201.57@tcp:35:bash.0 Request processed in 435us (970us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788574407.229797:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574407.346059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.346406:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727752448 00000100:00100000:3.0:1788574407.346417:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727752448 00000100:00100000:3.0:1788574407.346470:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:3.0:1788574407.346481:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+15:14440:x1875455727752448:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574407.346522:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574407.346546:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c8a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574407.346647:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788574407.346915:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536e6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c8a expref: 17 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.346931:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:3.0:1788574407.346934:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574407.346940:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c8a expref: 17 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.346956:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b400, rc 0) 00000100:00100000:3.0:1788574407.347024:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a793285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+16:14440:x1875455727752448:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 545us (976us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788574407.347031:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:2.0:1788574407.350395:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.350497:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727752704 00000100:00100000:0.0:1788574407.350511:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727752704 00000100:00100000:0.0:1788574407.350584:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:0.0:1788574407.350598:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+16:14440:x1875455727752704:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788574407.350901:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+17:14440:x1875455727752704:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 304us (539us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788574407.350909:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574407.421493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.421642:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727752960 00000100:00100000:0.0:1788574407.421652:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727752960 00000100:00100000:0.0:1788574407.421711:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788574407.421722:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+17:14443:x1875455727752960:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574407.421759:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574407.421787:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c91 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.421925:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116bc00/0x10531a153b536e81 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.421942:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116bc00/0x10531a153b536e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.421956:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116bc00/0x10531a153b536e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574407.421989:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574407.422157:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e7a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c91 expref: 20 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.422179:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116bc00/0x10531a153b536e81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c91 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.422188:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:0.0:1788574407.422191:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574407.422195:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116bc00, rc 0) 00000100:00100000:0.0:1788574407.422268:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+19:14443:x1875455727752960:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 548us (790us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788574407.422276:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788574407.428498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.428615:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727753088 00000100:00100000:0.0:1788574407.428631:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727753088 00000100:00100000:0.0:1788574407.428719:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788574407.428732:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+19:14443:x1875455727753088:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:0.0:1788574407.428843:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428865:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428880:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428919:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428947:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428955:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428961:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ba00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574407.428966:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428976:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.428993:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:0.0:1788574407.428996:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574407.429002:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.429008:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536e8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574407.429128:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+19:14443:x1875455727753088:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 397us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574407.429138:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:2.0:1788574407.431681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.431918:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727753344 00000100:00100000:0.0:1788574407.431927:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727753344 00000100:00100000:0.0:1788574407.431982:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788574407.431992:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+19:14443:x1875455727753344:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788574407.433277:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+20:14443:x1875455727753344:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 1276us (1597us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788574407.433304:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574407.438949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574407.439276:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727753472 00000100:00100000:1.0:1788574407.439286:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727753472 00000100:00100000:1.0:1788574407.439359:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788574407.439392:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5767af78-1871-405c-8c59-f96bc15eec86+20:2356:x1875455727753472:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574407.439410:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574407.439439:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116bc00/0x10531a153b536e81 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c91 expref: 20 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.439483:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:1.0:1788574407.439489:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574407.439554:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5767af78-1871-405c-8c59-f96bc15eec86+19:2356:x1875455727753472:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 186us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574407.439562:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000040:00080000:0.0:1788574407.553423:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574407.903655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.903897:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727753728 00000100:00100000:0.0:1788574407.903908:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727753728 00000100:00100000:0.0:1788574407.903996:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788574407.904014:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+19:14474:x1875455727753728:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:0.0:1788574407.904039:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574407.904059:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a600/0x10531a153b536e96 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c98 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.904154:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b536e9d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.904167:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b536e9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.904182:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b536e9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574407.904192:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574407.904346:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a600/0x10531a153b536e96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c98 expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.904405:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b536e9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c98 expref: 21 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574407.904415:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:0.0:1788574407.904418:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574407.904428:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ac00, rc 0) 00000100:00100000:0.0:1788574407.904483:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+21:14474:x1875455727753728:12345-192.168.201.57@tcp:101:cat.0 Request processed in 478us (838us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788574407.904490:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788574407.910582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574407.910641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574407.910759:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727753856 00000100:00100000:2.0:1788574407.910772:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727753856 00000100:00100000:2.0:1788574407.910963:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:2.0:1788574407.910975:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+21:2353:x1875455727753856:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574407.910993:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574407.911031:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b536e9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c98 expref: 21 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574407.911050:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:2.0:1788574407.911055:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574407.911129:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+20:2353:x1875455727753856:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 156us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574407.911136:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:1.0:1788574407.912022:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727754112 00000100:00100000:1.0:1788574407.912030:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727754112 00000100:00100000:1.0:1788574407.912071:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:1.0:1788574407.912088:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+20:14474:x1875455727754112:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:1.0:1788574407.912667:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+21:14474:x1875455727754112:12345-192.168.201.57@tcp:35:cat.0 Request processed in 576us (2020us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788574407.912674:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:0.0:1788574407.990891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.991043:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727754368 00000100:00100000:3.0:1788574407.991054:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727754368 00000100:00100000:3.0:1788574407.991124:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:3.0:1788574407.991134:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+21:14480:x1875455727754368:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:3.0:1788574407.991160:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574407.991181:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ae00/0x10531a153b536eab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3c9f expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.991300:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.991349:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 22 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.991359:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.991811:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.991862:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.991878:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 22 pid: 14345 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574407.991893:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1875455747666304:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788574407.992061:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 22 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574407.992080:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 22 pid: 14346 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574407.992090:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1875455747666432:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788574407.992116:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574407.998040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574407.998102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574407.998755:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727754496 00000100:00100000:1.0:1788574407.998769:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727754496 00010000:00010000:1.0:1788574407.998832:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 23 pid: 14345 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574407.998917:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727754624 00000100:00100000:1.0:1788574407.998921:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727754624 00010000:00010000:1.0:1788574407.998934:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 24 pid: 14346 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574407.998950:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788574407.998959:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7602c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+24:2354:x1875455727754496:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574407.998974:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574407.998990:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 24 pid: 14345 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999217:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 24 pid: 14345 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999242:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:1.0:1788574407.999246:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999254:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999261:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574407.999320:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7602c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+24:2354:x1875455727754496:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 363us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574407.999435:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788574407.999488:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574407.999497:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+23:2354:x1875455727754624:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574407.999506:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574407.999511:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 23 pid: 14346 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999522:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 23 pid: 14346 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999535:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:1.0:1788574407.999538:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999553:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999562:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574407.999582:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574407.999602:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+23:2354:x1875455727754624:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 107us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574407.999608:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00010000:00010000:0.0:1788574408.000941:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a400/0x10531a153b536e65 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c83 expref: 22 pid: 14345 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574408.000967:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1875455747666304:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574408.000983:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165aa00/0x10531a153b536e50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c7c expref: 21 pid: 14346 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574408.000993:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1875455747666432:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574408.001032:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.001042:0:14346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.001048:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574408.001077:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574408.001255:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ae00/0x10531a153b536eab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c9f expref: 22 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.001268:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c9f expref: 21 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.001289:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:0.0:1788574408.001293:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574408.001296:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b400, rc 0) 00000100:00100000:0.0:1788574408.001599:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+21:14480:x1875455727754368:12345-192.168.201.57@tcp:101:dd.0 Request processed in 10464us (10715us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788574408.001607:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:2.0:1788574408.004909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574408.005068:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727754880 00000100:00100000:3.0:1788574408.005138:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727754880 00000100:00100000:3.0:1788574408.005287:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:3.0:1788574408.005298:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+21:14480:x1875455727754880:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:3.0:1788574408.005603:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.005622:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.005634:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574408.005686:0:15051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788574408.005726:0:15051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050b79550 reply state 00000000b1b00700 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574408.005750:0:15051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574408.005918:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+24:14480:x1875455727754880:12345-192.168.201.57@tcp:36:dd.0 Request processed in 621us (1017us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788574408.005927:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000020:00080000:3.0:1788574408.005931:0:15051:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1788574408.008682:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574408.010603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788574408.010785:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.010802:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.010819:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.010825:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165ac00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574408.010849:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.010860:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.010881:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574408.010885:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574408.010891:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.010897:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ec0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574408.011072:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755008 00000100:00100000:2.0:1788574408.011129:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755008 00000100:00100000:2.0:1788574408.011238:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:2.0:1788574408.011248:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+23:14480:x1875455727755008:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:2.0:1788574408.011274:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574408.011293:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ec7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3ca6 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.011350:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ca6 expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.011364:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ca6 expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.011424:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:2.0:1788574408.011427:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574408.011430:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984800, rc 0) 00000100:00100000:2.0:1788574408.011512:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+24:14480:x1875455727755008:12345-192.168.201.57@tcp:101:dd.0 Request processed in 266us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.011520:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:1.0:1788574408.027268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.027356:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755264 00000100:00100000:2.0:1788574408.027392:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755264 00000100:00100000:3.0:1788574408.027588:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:3.0:1788574408.027599:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+24:14480:x1875455727755264:12345-192.168.201.57@tcp:103:dd.0 00010000:00010000:3.0:1788574408.027617:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574408.027642:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ec7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3ca6 expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.027661:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574408.027666:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574408.027718:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+23:14480:x1875455727755264:12345-192.168.201.57@tcp:103:dd.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574408.027725:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788574408.030458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.030591:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755392 00000100:00100000:1.0:1788574408.030602:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755392 00000100:00100000:1.0:1788574408.030656:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788574408.030667:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+23:14480:x1875455727755392:12345-192.168.201.57@tcp:58:dd.0 00010000:00010000:1.0:1788574408.030780:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.030798:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.030922:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574408.032166:0:14345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574408.032324:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788574408.032435:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788574408.032649:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+23:14480:x1875455727755392:12345-192.168.201.57@tcp:58:dd.0 Request processed in 1978us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.032671:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788574408.035455:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574408.035538:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755520 00000100:00100000:3.0:1788574408.035548:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755520 00000100:00100000:3.0:1788574408.035595:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788574408.035604:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+23:14480:x1875455727755520:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:3.0:1788574408.035636:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574408.035656:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cad expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.035713:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.035725:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 24 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.035755:0:14346:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.035768:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 24 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.035783:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574408.035786:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574408.035790:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 24 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.035798:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165be00, rc 0) 00000100:00100000:3.0:1788574408.035857:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+24:14480:x1875455727755520:12345-192.168.201.57@tcp:101:dd.0 Request processed in 254us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574408.035864:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00010000:00010000:3.0:1788574408.064535:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574408.491959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.492004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.492040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.492077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.492115:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755648 00000100:00100000:0.0:1788574408.492125:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755648 00000100:00100000:2.0:1788574408.492151:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755776 00000100:00100000:2.0:1788574408.492156:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755776 00000100:00100000:0.0:1788574408.492172:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788574408.492182:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727755648:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574408.492190:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756288 00000100:00100000:2.0:1788574408.492192:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756288 00000100:00100000:2.0:1788574408.492221:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:2.0:1788574408.492228:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727755776:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574408.492290:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788574408.492299:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788574408.492441:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788574408.492447:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727756288:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574408.492516:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727755648:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 335us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.492523:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:2.0:1788574408.500396:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727755776:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 8111us (8393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.500414:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00080000:2.0:1788574408.500478:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574408.500483:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574408.500981:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756032 00000100:00100000:2.0:1788574408.500995:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756032 00000100:00080000:2.0:1788574408.502721:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574408.503239:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788574408.503252:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:2353:x1875455727756032:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574408.503345:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+11:2353:x1875455727756032:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 95us (11340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.503407:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:3.0:1788574408.508324:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727756288:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 15861us (16267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574408.508345:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574408.510289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.510358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.510401:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727755904 00000100:00100000:0.0:1788574408.510413:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727755904 00000100:00100000:0.0:1788574408.510477:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756160 00000100:00100000:0.0:1788574408.510479:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756160 00000100:00100000:0.0:1788574408.510506:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574408.510540:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727755904:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574408.510627:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727755904:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.510636:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788574408.510657:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574408.510663:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727756160:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574408.510687:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2353:x1875455727756160:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.510693:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00080000:0.0:1788574408.510708:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574408.510711:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788574408.577461:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788574408.577471:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574408.577510:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788574408.577516:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788574408.577669:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14378:1875455747666560:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574408.577798:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7b2175b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574408.584676:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14378:1875455747666560:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788574408.591577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.596024:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756416 00000100:00100000:0.0:1788574408.596042:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756416 00000100:00100000:0.0:1788574408.596124:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788574408.596135:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a791d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756416:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788574408.596236:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a791d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756416:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 Request processed in 103us (4672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.596243:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788574408.616859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574408.617016:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756544 00000100:00100000:3.0:1788574408.617029:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756544 00000100:00100000:3.0:1788574408.617100:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788574408.617122:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756544:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574408.617159:0:14346:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574408.617309:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756544:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 190us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574408.617317:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788574408.626418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.635956:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756672 00000100:00100000:2.0:1788574408.635975:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756672 00000100:00100000:2.0:1788574408.636126:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:2.0:1788574408.636138:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756672:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788574408.636236:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636254:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636267:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636321:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636329:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636336:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636360:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636387:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636396:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574408.636461:0:15051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788574408.636466:0:15051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574408.636486:0:15051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636498:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636504:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636512:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636518:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574408.636523:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636531:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636544:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:2.0:1788574408.636547:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574408.636552:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636559:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536edc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636575:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636591:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636596:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636601:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574408.636604:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636609:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636617:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90a782d70600) 00010000:00010000:2.0:1788574408.636620:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574408.636622:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636628:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536ee3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636645:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636651:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636658:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636664:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574408.636674:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636680:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636688:0:15051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:2.0:1788574408.636690:0:15051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574408.636693:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.636699:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536eea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574408.637857:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756672:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 1710us (11439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.637868:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:2.0:1788574408.672182:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574408.672501:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727756928 00000100:00100000:3.0:1788574408.672513:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727756928 00000100:00100000:3.0:1788574408.672598:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:3.0:1788574408.672610:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+24:14481:x1875455727756928:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574408.672638:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574408.672662:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ef1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cb4 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687209:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687237:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687250:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574408.687267:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788574408.687388:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687397:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687420:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687426:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574408.687431:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687439:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687452:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:2.0:1788574408.687455:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788574408.687460:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687466:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536ef8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687521:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ef1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cb4 expref: 26 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687531:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:2.0:1788574408.687533:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574408.687537:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ac00/0x10531a153b536ef1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cb4 expref: 26 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.687548:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165ac00, rc 0) 00000100:00100000:2.0:1788574408.687627:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+25:14481:x1875455727756928:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 15020us (15454us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788574408.687644:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:0.0:1788574408.691284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.691398:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727757056 00000100:00100000:1.0:1788574408.691409:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727757056 00000100:00100000:1.0:1788574408.691466:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788574408.691475:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+25:14481:x1875455727757056:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788574408.691515:0:14345:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788574408.691634:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+25:14481:x1875455727757056:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 159us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.691641:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788574408.697270:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.697468:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727757312 00000100:00100000:1.0:1788574408.697483:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727757312 00000100:00100000:1.0:1788574408.697558:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788574408.697570:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+25:14481:x1875455727757312:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574408.697596:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574408.697620:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f06 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cbb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574408.704830:0:14344:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788574408.704842:0:14344:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788574408.704892:0:14344:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788574408.705212:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20000/0x10531a153b536f0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.705241:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20000/0x10531a153b536f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.705255:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20000/0x10531a153b536f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.705332:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f06 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cbb expref: 28 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.705354:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20000/0x10531a153b536f0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cbb expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.705364:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a786819e00) 00010000:00010000:1.0:1788574408.705421:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574408.705426:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20000, rc 0) 00000100:00100000:1.0:1788574408.705492:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+27:14481:x1875455727757312:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 7923us (8235us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788574408.705502:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:2.0:1788574408.717939:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.718023:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727757568 00000100:00100000:1.0:1788574408.718034:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727757568 00000100:00100000:1.0:1788574408.718087:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:1.0:1788574408.718097:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+27:14481:x1875455727757568:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574408.718160:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574408.718189:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a20000/0x10531a153b536f0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cbb expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718223:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a786819e00) 00010000:00010000:1.0:1788574408.718251:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574408.718277:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718291:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718303:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718318:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718325:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718330:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718479:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718489:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718496:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718502:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574408.718507:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718516:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718532:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:1.0:1788574408.718534:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574408.718539:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718545:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21a00/0x10531a153b536f1b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718554:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718561:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718566:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718572:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574408.718575:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718581:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718588:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x77b2156d (ffff90a786819700) 00010000:00010000:1.0:1788574408.718590:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574408.718592:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574408.718598:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21400/0x10531a153b536f22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x77b2156d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574408.718701:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+26:14481:x1875455727757568:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 603us (770us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574408.718709:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:0.0:1788574408.722274:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.722422:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727757696 00000100:00100000:2.0:1788574408.722437:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727757696 00000100:00100000:2.0:1788574408.722505:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:2.0:1788574408.722516:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+26:14481:x1875455727757696:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574408.722537:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574408.722560:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f29 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cc2 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.722601:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536f30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.722618:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536f30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.722630:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536f30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.722742:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f29 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc2 expref: 28 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.722762:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536f30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc2 expref: 27 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.722773:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:2.0:1788574408.722776:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574408.722788:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574408.722862:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+27:14481:x1875455727757696:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 347us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.722870:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:0.0:1788574408.728477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574408.728709:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727757952 00000100:00100000:3.0:1788574408.728725:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727757952 00000100:00100000:3.0:1788574408.728812:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:3.0:1788574408.728830:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+27:14481:x1875455727757952:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574408.728982:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.729005:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.729021:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574408.729557:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788574408.729569:0:14345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 534904200761ns, next at 535904197078ns, rc = 0 00000004:00010000:3.0:1788574408.729673:0:14345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5f6a140 reply state 0000000050225411 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574408.729683:0:14345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574408.729797:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+29:14481:x1875455727757952:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 970us (1336us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788574408.729806:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00010000:00010000:0.0:1788574408.739294:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.739320:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.739328:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.739336:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165ba00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574408.739341:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.739351:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.739423:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:0.0:1788574408.739428:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788574408.739435:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.739441:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165ba00/0x10531a153b536f37 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574408.742363:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.742547:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727758080 00000100:00100000:2.0:1788574408.742566:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727758080 00000100:00100000:2.0:1788574408.742638:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788574408.742650:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+28:14481:x1875455727758080:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574408.742676:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574408.742699:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cc9 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.742773:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 29 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.742792:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 29 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.742818:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:2.0:1788574408.742822:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574408.742827:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984800, rc 0) 00000100:00100000:2.0:1788574408.742923:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+29:14481:x1875455727758080:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 275us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.742930:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:3.0:1788574408.745659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574408.747155:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727758208 00000100:00100000:0.0:1788574408.747177:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727758208 00000100:00100000:0.0:1788574408.747281:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788574408.747292:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727758208:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788574408.747814:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:2356:x1875455727758208:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 521us (2165us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788574408.747823:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788574408.751124:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.752328:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727758464 00000100:00100000:1.0:1788574408.752344:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727758464 00000100:00100000:1.0:1788574408.752464:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788574408.752476:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+29:14481:x1875455727758464:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574408.752738:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+30:14481:x1875455727758464:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 263us (1627us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788574408.752745:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574408.755291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.756434:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727758720 00000100:00100000:1.0:1788574408.756450:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727758720 00000100:00100000:1.0:1788574408.756528:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:1.0:1788574408.756540:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+30:14481:x1875455727758720:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574408.756658:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+30:14481:x1875455727758720:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 121us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.756665:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:3.0:1788574408.761878:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.763045:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727758848 00000100:00100000:2.0:1788574408.763060:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727758848 00000100:00100000:2.0:1788574408.763143:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788574408.763154:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+30:14481:x1875455727758848:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574408.763202:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574408.763228:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536f45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cd0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.763304:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985000/0x10531a153b536f4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.763323:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985000/0x10531a153b536f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.763337:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985000/0x10531a153b536f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574408.763420:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574408.763447:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985000/0x10531a153b536f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.763478:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985200/0x10531a153b536f45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd0 expref: 32 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.763501:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985000/0x10531a153b536f4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd0 expref: 31 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.763509:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:2.0:1788574408.763512:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788574408.763517:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985000, rc 0) 00000100:00100000:2.0:1788574408.763606:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+31:14481:x1875455727758848:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 453us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.763614:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:0.0:1788574408.770518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.772397:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727758976 00000100:00100000:2.0:1788574408.772416:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727758976 00000100:00100000:2.0:1788574408.772489:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788574408.772498:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+6:2356:x1875455727758976:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574408.772517:0:16578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574408.772537:0:16578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cd7 expref: -99 pid: 16578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574408.772564:0:16578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7ac9, blocks: 0x1 00010000:00010000:2.0:1788574408.772583:0:16578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=534s v=(0 0) 00010000:00010000:2.0:1788574408.772588:0:16578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574408.772598:0:16578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.772617:0:16578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574408.772630:0:16578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985200, rc 0) 00000100:00100000:2.0:1788574408.772691:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+7:2356:x1875455727758976:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 194us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574408.772698:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788574408.780126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.780250:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727759232 00000100:00100000:1.0:1788574408.780265:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727759232 00000100:00100000:1.0:1788574408.780339:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:1.0:1788574408.780350:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+31:14481:x1875455727759232:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574408.780522:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+31:14481:x1875455727759232:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.780531:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:0.0:1788574408.797083:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574408.797242:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727759360 00000100:00100000:2.0:1788574408.797255:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727759360 00000100:00100000:2.0:1788574408.797327:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:2.0:1788574408.797338:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+31:14481:x1875455727759360:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788574408.836491:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747666944:0@lo:400:kworker.0 00000100:00100000:1.0:1788574408.836563:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574408.836615:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574408.836622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747667072:0@lo:400:kworker.0 00000100:00100000:1.0:1788574408.836648:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574408.836683:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747666944 00000100:00100000:1.0:1788574408.836691:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747666944 00000100:00100000:1.0:1788574408.836755:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574408.836766:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747666944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574408.836827:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747666944:12345-0@lo:400:kworker.0 Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.836834:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788574408.836853:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574408.836880:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747666944:0@lo:400:kworker.0 00000100:00100000:1.0:1788574408.836907:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747667072 00000100:00100000:1.0:1788574408.836910:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747667072 00000100:00100000:1.0:1788574408.836932:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574408.836938:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747667072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574408.836972:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747667072:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.836979:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574408.837002:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747667072:0@lo:400:kworker.0 00000100:00100000:1.0:1788574408.837811:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574408.837824:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747667456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574408.837864:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574408.837922:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747667456 00000100:00100000:1.0:1788574408.837938:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747667456 00000100:00100000:1.0:1788574408.837969:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574408.837976:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747667456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574408.838004:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574408.838040:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747667456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.838046:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574408.838083:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747667456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574408.838771:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747666688:0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.838923:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574408.838961:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747667200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574408.839016:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747666688 00000100:00100000:0.0:1788574408.839024:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747666688 00000100:00100000:0.0:1788574408.839073:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788574408.839080:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747666688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.839114:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574408.839121:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747666688:12345-0@lo:400:kworker.0 Request processed in 42us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.839127:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788574408.839149:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747666688:0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.839161:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788574408.839181:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a791d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747666816:0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.839219:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574408.839247:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747667328:0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.839271:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574408.839324:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747667200 00000100:00100000:3.0:1788574408.839328:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747667200 00000100:00100000:0.0:1788574408.839543:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747666816 00000100:00100000:0.0:1788574408.839547:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747666816 00000100:00100000:3.0:1788574408.840247:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747667328 00000100:00100000:3.0:1788574408.840253:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747667328 00000100:00100000:0.0:1788574408.843250:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574408.843264:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747666816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574408.843352:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747666816:12345-0@lo:400:kworker.0 Request processed in 92us (4131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.843358:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574408.846301:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574408.846317:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747667200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.849957:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747667200:12345-0@lo:400:kworker.0 Request processed in 3633us (10953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574408.849975:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574408.850026:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574408.850039:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747667328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.850266:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747667328:12345-0@lo:400:kworker.0 Request processed in 232us (10992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574408.850272:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788574408.852837:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574408.853639:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a791d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747666816:0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.853656:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747667328:0@lo:400:kworker.0 00000100:00100000:3.0:1788574408.853668:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a793284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747667200:0@lo:400:kworker.0 00000100:00080000:1.0:1788574408.863360:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788574408.956547:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:0.0:1788574408.956572:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1788574408.956580:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788574408.956597:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788574408.956717:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574408.956738:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747667584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788574408.956829:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574408.956985:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+14:14481:x1875455727759360:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 159645us (159912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.957007:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574408.959825:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747667584 00000100:00100000:1.0:1788574408.959842:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747667584 00000100:00100000:1.0:1788574408.959920:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574408.959933:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747667584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788574408.960211:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788574408.960216:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788574408.960219:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788574408.960221:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788574409 -> 1788574409 00002000:00010000:1.0:1788574408.960224:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788574408.960316:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747667584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 386us (3486us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788574408.960325:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788574408.960768:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a6839d1180/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788574408.960776:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747667584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788574408.967221:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574408.970108:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727759488 00000100:00100000:1.0:1788574408.970123:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727759488 00000100:00100000:1.0:1788574408.970198:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788574408.970209:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+7:2355:x1875455727759488:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788574408.970341:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+7:2355:x1875455727759488:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 133us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.970401:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000001:00080000:1.0:1788574408.972110:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788574408.973538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574408.973655:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727759744 00000100:00100000:3.0:1788574408.973665:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727759744 00000100:00100000:3.0:1788574408.973749:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788574408.973760:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+14:14481:x1875455727759744:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574408.973830:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574408.973867:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985000/0x10531a153b536f4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd0 expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.973996:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574408.974004:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574408.974042:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.974124:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.974136:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574408.976214:0:14345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009528b216 reply state 000000001b12ab93 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574408.976233:0:14345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574408.977950:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+15:14481:x1875455727759744:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 4179us (4408us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788574408.977963:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00010000:00010000:0.0:1788574409.003106:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.003125:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.003133:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.003140:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574409.003145:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.003152:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.003172:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:0.0:1788574409.003175:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574409.003180:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.003186:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a400/0x10531a153b536f5a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574409.015868:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574409.016064:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727759872 00000100:00100000:1.0:1788574409.016074:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727759872 00000100:00100000:1.0:1788574409.016172:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:1.0:1788574409.016183:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+6:14481:x1875455727759872:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574409.016211:0:15029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574409.016230:0:15029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cde expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.016261:0:15029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.016270:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788574409.016274:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574409.016279:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 7 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.016344:0:15029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.016359:0:15029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574409.016410:0:15029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15029:1875455747667712:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788574409.016548:0:15029:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7853db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574409.022500:0:15029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15029:1875455747667712:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574409.022548:0:15029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 7 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.022576:0:15029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21a00, rc 0) 00000100:00100000:1.0:1788574409.022653:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+7:14481:x1875455727759872:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 6469us (6809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574409.022664:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574409.039263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574409.039413:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760000 00000100:00100000:0.0:1788574409.039425:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760000 00010000:00010000:0.0:1788574409.039471:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574409.039510:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788574409.039520:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5767af78-1871-405c-8c59-f96bc15eec86+7:2355:x1875455727760000:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574409.039535:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574409.039559:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.039575:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.039601:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026d59447/0x10531a153b536f53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cd7 expref: 7 pid: 16578 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.039619:0:14331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574409.039624:0:14331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574409.039631:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 6 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.039642:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 6 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.039679:0:14331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 6 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574409.039707:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14331:1875455747667840:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788574409.039807:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574409.047419:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14331:1875455747667840:192.168.201.57@tcp:105: 00010000:00010000:3.0:1788574409.047453:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574409.047536:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5767af78-1871-405c-8c59-f96bc15eec86+6:2355:x1875455727760000:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 8015us (8281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574409.047577:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788574409.050142:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574409.050249:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760128 00000100:00100000:0.0:1788574409.050259:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760128 00000100:00100000:0.0:1788574409.050317:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788574409.050326:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+6:2355:x1875455727760128:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788574409.050561:0:15028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788574409.050565:0:15028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788574408 00002000:00010000:0.0:1788574409.050567:0:15028:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788574407 00002000:00010000:0.0:1788574409.050570:0:15028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788574409 -> 1788574408 00002000:00010000:0.0:1788574409.050572:0:15028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788574409.050626:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5767af78-1871-405c-8c59-f96bc15eec86+7:2355:x1875455727760128:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 301us (494us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788574409.050633:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:1.0:1788574409.063148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574409.063295:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760256 00000100:00100000:2.0:1788574409.063318:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760256 00000100:00100000:2.0:1788574409.063422:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:2.0:1788574409.063432:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5767af78-1871-405c-8c59-f96bc15eec86+7:2356:x1875455727760256:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788574409.063477:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.063498:0:15030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 7 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.063506:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.063510:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574409.063515:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.063548:0:15030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 7 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.063562:0:15030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 7 pid: 15029 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574409.063575:0:15030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15030:1875455747667968:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574409.063667:0:15030:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574409.067441:0:15030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15030:1875455747667968:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574409.067480:0:15030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574409.069068:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574409.069443:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760384 00000100:00100000:3.0:1788574409.069455:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760384 00010000:00010000:3.0:1788574409.069496:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 8 pid: 15029 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574409.069539:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788574409.069549:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+8:2356:x1875455727760384:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574409.069564:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574409.069587:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 8 pid: 15029 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.069603:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 8 pid: 15029 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.069628:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059982c06/0x10531a153b536f61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cde expref: 8 pid: 15029 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.069648:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574409.069653:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574409.069659:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.069668:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.069727:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574409.069801:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5767af78-1871-405c-8c59-f96bc15eec86+7:2356:x1875455727760384:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 253us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574409.069808:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00010000:00010000:0.0:1788574409.070279:0:15030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070289:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070323:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070332:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070340:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070347:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574409.070352:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070360:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070400:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.070408:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b536f68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574409.070469:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5767af78-1871-405c-8c59-f96bc15eec86+6:2356:x1875455727760256:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 7038us (7329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574409.070484:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:1.0:1788574409.074140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574409.075418:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760640 00000100:00100000:2.0:1788574409.075433:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760640 00000100:00100000:2.0:1788574409.075502:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:2.0:1788574409.075514:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+14:14481:x1875455727760640:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788574409.075633:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.075653:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.075667:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.076211:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.076224:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 15 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.076232:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.076268:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 15 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.076281:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 15 pid: 14346 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574409.076297:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14344:1875455747668096:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574409.076439:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574409.088326:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14344:1875455747668096:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574409.088365:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.088648:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574409.102520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574409.102777:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760768 00000100:00100000:3.0:1788574409.102788:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760768 00010000:00010000:3.0:1788574409.102834:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 16 pid: 14346 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574409.102885:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788574409.102896:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5767af78-1871-405c-8c59-f96bc15eec86+16:2356:x1875455727760768:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574409.102913:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574409.102921:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 16 pid: 14346 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.102951:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 16 pid: 14346 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.102974:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc9 expref: 16 pid: 14346 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.102994:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574409.103000:0:14331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.103011:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.103036:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.103141:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574409.103240:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5767af78-1871-405c-8c59-f96bc15eec86+15:2356:x1875455727760768:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 344us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574409.103247:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00010000:00010000:2.0:1788574409.107196:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.107237:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574409.107907:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788574409.108836:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788574409.108899:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788574409.108986:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14344:1875455747668224:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788574409.110435:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574409.110481:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574409.111195:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747668224 00000100:00100000:0.0:1788574409.111206:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747668224 00000100:00100000:0.0:1788574409.111261:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574409.111271:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1875455747668224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788574409.116955:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1875455747668224:12345-0@lo:1000:mdt00_000.0 Request processed in 5678us (6587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574409.116969:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574409.117098:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14344:1875455747668224:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788574409.117832:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788574409.117917:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14344:1875455747668352:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788574409.117962:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574409.118003:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747668352 00000100:00100000:3.0:1788574409.118010:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747668352 00000100:00100000:3.0:1788574409.118045:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574409.118053:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1875455747668352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788574409.118224:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14344:x1875455747668352:12345-0@lo:1000:mdt00_000.0 Request processed in 170us (260us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788574409.118232:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574409.118263:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574409.118283:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14344:1875455747668352:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788574409.118316:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118327:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118334:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118346:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985600 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574409.118350:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118358:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118396:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574409.118399:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574409.118404:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118411:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985600/0x10531a153b536f76 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118441:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118447:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118453:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118457:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574409.118460:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118465:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118483:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574409.118485:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574409.118492:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118503:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118512:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574409.118560:0:14344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574409.118571:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14344:1875455747668480:192.168.201.57@tcp:105: 00000100:00100000:3.0:1788574409.118721:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574409.125541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574409.131430:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727760896 00000100:00100000:0.0:1788574409.131453:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727760896 00000100:00100000:0.0:1788574409.131547:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:0.0:1788574409.131560:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78636c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+19:14480:x1875455727760896:12345-192.168.201.57@tcp:49:dd.0 00000100:00100000:0.0:1788574409.131737:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78636c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+19:14480:x1875455727760896:12345-192.168.201.57@tcp:49:dd.0 Request processed in 181us (6210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574409.131745:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574409.137221:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14344:1875455747668480:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788574409.137260:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137272:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21000/0x10531a153b536ece lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137316:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137344:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137357:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137402:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137408:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137434:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137439:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574409.137443:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137450:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137462:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:2.0:1788574409.137465:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574409.137468:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137473:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e984800/0x10531a153b536f7d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137482:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137488:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137492:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137496:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574409.137499:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137513:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137520:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:2.0:1788574409.137522:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574409.137525:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.137530:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985e00/0x10531a153b536f6f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574409.137937:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788574409.137942:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574409.137984:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788574409.137988:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788574409.138874:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+18:14481:x1875455727760640:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 63357us (64760us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788574409.138886:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000020:00080000:2.0:1788574409.138892:0:14344:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788574409.161105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574409.161249:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761152 00000100:00100000:0.0:1788574409.161259:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761152 00000100:00100000:0.0:1788574409.161317:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788574409.161328:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+18:14481:x1875455727761152:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788574409.162688:0:14347:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788574409.162926:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788574409.162992:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.163010:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.163023:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.163032:0:14347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.163038:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.163043:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.168490:0:14347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574409.168680:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574409.168688:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.168697:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ba00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574409.168701:0:15396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.168721:0:15396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.168738:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:2.0:1788574409.168741:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788574409.168746:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.168768:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ba00/0x10531a153b536f84 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.168784:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574409.168786:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574409.168788:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574409.170265:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+20:14481:x1875455727761152:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 8928us (9157us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788574409.170279:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000020:00080000:0.0:1788574409.170285:0:14347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788574409.344694:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574409.344738:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747668608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574409.344833:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574409.344994:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747668608 00000100:00100000:1.0:1788574409.345003:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747668608 00000100:00100000:1.0:1788574409.345071:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574409.345083:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747668608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574409.345124:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574409.345177:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747668608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574409.345193:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574409.345407:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747668608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574409.540532:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574409.540592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574409.540700:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761408 00000100:00100000:0.0:1788574409.540718:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761408 00000100:00100000:0.0:1788574409.540795:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761536 00000100:00100000:0.0:1788574409.540798:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761536 00000100:00100000:0.0:1788574409.540841:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788574409.540852:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5767af78-1871-405c-8c59-f96bc15eec86+7:2354:x1875455727761408:12345-192.168.201.57@tcp:4:dd.0 00002000:00010000:0.0:1788574409.540911:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b7ac8, atime: 0x6a9b7ac7, ctime: 0x6a9b7ac8, blocks: 0x1 00010000:00010000:0.0:1788574409.540923:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.540943:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788574409.540948:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574409.540956:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.540975:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574409.543571:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574409.543698:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574409.543722:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788574409.544832:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761280 00000100:00100000:1.0:1788574409.544849:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761280 00000100:00100000:2.0:1788574409.545449:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:2.0:1788574409.545464:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5767af78-1871-405c-8c59-f96bc15eec86+9:2354:x1875455727761536:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:2.0:1788574409.545509:0:16581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.545529:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.545534:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.545540:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.545558:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574409.717110:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1788574409.717143:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1788574409.717152:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1788574409.717170:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1788574409.717203:0:15033:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788574408 -> 1788574409 00002000:00010000:0.0:1788574409.717207:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1788574409.717226:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717238:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717247:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717254:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ac00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574409.717273:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717284:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717307:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717315:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058629783/0x10531a153b536f8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574409.717448:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5767af78-1871-405c-8c59-f96bc15eec86+10:2354:x1875455727761408:12345-192.168.201.57@tcp:4:dd.0 Request processed in 176593us (176928us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788574409.717458:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788574409.717493:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788574409.717503:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5767af78-1871-405c-8c59-f96bc15eec86+9:2356:x1875455727761280:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:0.0:1788574409.717544:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717558:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574409.717562:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574409.717567:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574409.717581:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574409.826920:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1788574409.828984:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:1.0:1788574409.829015:0:16581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.829029:0:16581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.829039:0:16581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.829047:0:16581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574409.829053:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.829063:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.829094:0:16581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.829101:0:16581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b536f92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574409.829285:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5767af78-1871-405c-8c59-f96bc15eec86+9:2354:x1875455727761536:12345-192.168.201.57@tcp:4:dd.0 Request processed in 283819us (288685us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788574409.829297:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:2.0:1788574409.860967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574409.861065:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761792 00000100:00100000:1.0:1788574409.861078:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761792 00000100:00100000:1.0:1788574409.861188:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788574409.861201:0:15034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5767af78-1871-405c-8c59-f96bc15eec86+9:2356:x1875455727761792:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:1.0:1788574409.861241:0:15034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.861262:0:15034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788574409.861266:0:15034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574409.861273:0:15034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.861288:0:15034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574409.875928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574409.876324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574409.881930:0:16581:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574409.882197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574409.882240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574409.882257:0:15035:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574409.882266:0:15035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788574409.886298:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761664 00000100:00100000:1.0:1788574409.886315:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761664 00000100:00100000:1.0:1788574409.886437:0:15035:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788574409.886451:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762048 00000100:00100000:1.0:1788574409.886454:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762048 00000100:00100000:1.0:1788574409.886473:0:15035:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788574409.886479:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762176 00000100:00100000:1.0:1788574409.886483:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762176 00000100:00100000:1.0:1788574409.886498:0:15035:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788574409.886523:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727761920 00000100:00100000:1.0:1788574409.886526:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727761920 00000100:00100000:2.0:1788574409.887194:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574409.887219:0:16582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5767af78-1871-405c-8c59-f96bc15eec86+14:2353:x1875455727761664:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:2.0:1788574409.887278:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.887302:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.887307:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.887315:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.887348:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574409.890350:0:16581:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1788574409.892024:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788574409.892065:0:16583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5767af78-1871-405c-8c59-f96bc15eec86+15:2353:x1875455727762048:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:1.0:1788574409.892134:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.892157:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574409.892162:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574409.892170:0:16583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574409.892197:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574409.967169:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788574409.967801:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00010000:00010000:2.0:1788574409.967827:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.967843:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.967854:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.967862:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574409.967869:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.967880:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.967918:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.967928:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b108cfc/0x10531a153b536f99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574409.968018:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5767af78-1871-405c-8c59-f96bc15eec86+19:2356:x1875455727761280:12345-192.168.201.57@tcp:4:dd.0 Request processed in 250512us (424450us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788574409.968027:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574409.968068:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574409.968080:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5767af78-1871-405c-8c59-f96bc15eec86+18:2353:x1875455727762176:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:2.0:1788574409.968114:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.968126:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.968130:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574409.968137:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574409.968149:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574410.105694:0:16583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788574410.105894:0:16583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:0.0:1788574410.112754:0:15034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.112778:0:15034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.112789:0:15034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.112797:0:15034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574410.112803:0:15034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.112813:0:15034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.112837:0:15034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.112846:0:15034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000be78406/0x10531a153b536fa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574410.112960:0:15034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5767af78-1871-405c-8c59-f96bc15eec86+20:2356:x1875455727761792:12345-192.168.201.57@tcp:4:dd.0 Request processed in 251757us (252000us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788574410.112986:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:0.0:1788574410.113021:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788574410.113044:0:15034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5767af78-1871-405c-8c59-f96bc15eec86+19:2356:x1875455727761920:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:0.0:1788574410.113081:0:15034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.113096:0:15034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574410.113101:0:15034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574410.113108:0:15034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.113121:0:15034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574410.113446:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00010000:00010000:1.0:1788574410.113794:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574410.113806:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788574410.113887:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.113908:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.113917:0:16583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.113923:0:16583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574410.113928:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.113939:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.113953:0:16583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.113960:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f382753d/0x10531a153b536fae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574410.114330:0:16583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5767af78-1871-405c-8c59-f96bc15eec86+13:2353:x1875455727762048:12345-192.168.201.57@tcp:4:dd.0 Request processed in 222277us (238003us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788574410.114339:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00010000:00010000:3.0:1788574410.118948:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.118972:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.119004:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.119011:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574410.119017:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.119027:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.119054:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.119064:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000292735f0/0x10531a153b536fa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574410.119529:0:16582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5767af78-1871-405c-8c59-f96bc15eec86+11:2353:x1875455727761664:12345-192.168.201.57@tcp:4:dd.0 Request processed in 232305us (243604us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788574410.119557:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000001:00080000:3.0:1788574410.195952:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1788574410.196733:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788574410.196752:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.196787:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.196797:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.196805:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574410.196810:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.196823:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.196849:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.196858:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71ef7a4/0x10531a153b536fb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574410.196975:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5767af78-1871-405c-8c59-f96bc15eec86+9:2353:x1875455727762176:12345-192.168.201.57@tcp:4:dd.0 Request processed in 228892us (314779us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788574410.196985:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000001:00080000:0.0:1788574410.352577:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1788574410.353162:0:15034:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788574410.353189:0:15034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.353201:0:15034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.353227:0:15034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.353234:0:15034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ba00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574410.353239:0:15034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.353248:0:15034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.353269:0:15034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574410.353277:0:15034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05f2a98/0x10531a153b536fbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574410.353477:0:15034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727761920:12345-192.168.201.57@tcp:4:dd.0 Request processed in 240439us (471227us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788574410.353489:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00010000:00010000:2.0:1788574411.136621:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574412.160896:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574412.424630:0:16620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788574413.184889:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574413.616191:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574413.616248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574413.616358:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762432 00000100:00100000:1.0:1788574413.616421:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762432 00000100:00100000:1.0:1788574413.616497:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:1.0:1788574413.616510:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+20:2353:x1875455727762432:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574413.616599:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+20:2353:x1875455727762432:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.616606:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00080000:3.0:1788574413.617018:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574413.617265:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762304 00000100:00100000:0.0:1788574413.617271:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762304 00000100:00100000:0.0:1788574413.617310:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:0.0:1788574413.617318:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727762304:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574413.617357:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727762304:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 40us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574413.617364:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:2.0:1788574413.623341:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574413.623427:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574413.623460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574413.623493:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574413.623518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574413.623595:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762688 00000100:00100000:1.0:1788574413.623605:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762688 00000100:00100000:1.0:1788574413.623671:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762560 00000100:00100000:1.0:1788574413.623675:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762560 00000100:00100000:1.0:1788574413.623688:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762944 00000100:00100000:1.0:1788574413.623691:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762944 00000100:00100000:1.0:1788574413.623703:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763072 00000100:00100000:1.0:1788574413.623773:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763072 00000100:00100000:1.0:1788574413.623796:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:1.0:1788574413.623805:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727762688:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574413.623878:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727762688:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 74us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.623885:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:1.0:1788574413.623903:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:1.0:1788574413.623909:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+5:2352:x1875455727762560:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:1.0:1788574413.623928:0:16578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536cb3 00000100:00080000:1.0:1788574413.623944:0:16578:0:(import.c:65:import_set_state_nolock()) ffff90a683b2d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574413.623981:0:16578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788574413.624213:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5767af78-1871-405c-8c59-f96bc15eec86+2:2352:x1875455727762560:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 302us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.624220:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:1.0:1788574413.624232:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788574413.624240:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c0609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2352:x1875455727762944:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:1.0:1788574413.624251:0:16578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536ceb 00000100:00080000:1.0:1788574413.624257:0:16578:0:(import.c:65:import_set_state_nolock()) ffff90a683b2b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574413.624277:0:16578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788574413.624349:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c0609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+2:2352:x1875455727762944:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 109us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.624396:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788574413.624512:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788574413.624520:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2352:x1875455727763072:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:1.0:1788574413.624534:0:16578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536cf2 00000100:00080000:1.0:1788574413.624541:0:16578:0:(import.c:65:import_set_state_nolock()) ffff90a683b29000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574413.624561:0:16578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788574413.624699:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+2:2352:x1875455727763072:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 180us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574413.624813:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727762816 00000100:00100000:3.0:1788574413.624818:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727762816 00000100:00100000:3.0:1788574413.624851:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:3.0:1788574413.624858:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727762816:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574413.624886:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727762816:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 29us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574413.624901:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00010000:00010000:3.0:1788574413.624943:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574413.625087:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574413.625093:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574413.625475:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574413.625481:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574413.625483:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574413.627165:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788574413.952743:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747668736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574413.952822:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.952921:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747668736 00000100:00100000:1.0:1788574413.952929:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747668736 00000100:00100000:1.0:1788574413.952985:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574413.952995:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747668736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574413.953030:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788574413.953074:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747668736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.953082:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574413.953134:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788574413.953139:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a6839d1180, transno 8589934595 00000004:00080000:1.0:1788574413.953150:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788574413.953177:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747668736:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788574413.955337:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574413.955504:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747668992:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.955569:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574413.955605:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574413.955612:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747668864:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.955643:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574413.955668:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747669376:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.955691:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574413.955721:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747668992 00000100:00100000:2.0:1788574413.955728:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747668992 00000100:00100000:2.0:1788574413.955779:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574413.955788:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747668992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.955837:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747668992:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574413.955844:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574413.955867:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747668864 00000100:00100000:2.0:1788574413.955870:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747668864 00000100:00100000:2.0:1788574413.955894:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788574413.955900:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bf9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3315:x1875455747668864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.955943:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bf9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3315:x1875455747668864:12345-0@lo:400:kworker.0 Request processed in 42us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574413.955950:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788574413.955995:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669376 00000100:00100000:2.0:1788574413.955999:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669376 00000100:00100000:2.0:1788574413.956037:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574413.956044:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747669376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956072:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747669376:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574413.956078:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574413.956110:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747669120:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574413.956155:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574413.956160:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747669248:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956179:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574413.956202:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669120 00000100:00100000:2.0:1788574413.956205:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669120 00000100:00100000:2.0:1788574413.956224:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669248 00000100:00100000:2.0:1788574413.956226:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669248 00000100:00100000:2.0:1788574413.956240:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574413.956245:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747669120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956272:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747669120:12345-0@lo:400:kworker.0 Request processed in 27us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574413.956278:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574413.956287:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574413.956292:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747669248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956321:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747669248:12345-0@lo:400:kworker.0 Request processed in 28us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574413.956326:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788574413.956341:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574413.956344:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574413.956384:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747669248:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956395:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747669120:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956423:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747668864:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956431:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747669376:0@lo:400:kworker.0 00000100:00100000:2.0:1788574413.956439:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747668992:0@lo:400:kworker.0 00000001:00080000:0.0:1788574414.130599:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788574414.130648:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7933f8480 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:0.0:1788574414.130661:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a78e118e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7933f86c0 00000020:00080000:0.0:1788574414.130665:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a78e118000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a7bca86c00 00000020:00080000:2.0:1788574414.130842:0:14382:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:2.0:1788574414.131049:0:14382:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788574414.213807:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574414.465890:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747669504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574414.465958:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574414.466032:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669504 00000100:00100000:0.0:1788574414.466039:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669504 00000100:00100000:0.0:1788574414.466084:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574414.466103:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747669504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574414.466142:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574414.466188:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747669504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574414.466195:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574414.466244:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747669504:0@lo:13:osp-pre-0-0.0 Debug log: 30025 lines, 30025 kept, 0 dropped, 0 bad.